-- Logs begin at Mon 2022-10-10 11:19:24 UTC, end at Mon 2022-10-10 12:16:58 UTC. -- Oct 10 11:50:34.426306 dv-cinder-850618-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 11:50:34.435305 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 11:50:34 2022] *** Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: nodename: dv-cinder-850618-4-iscsi Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: machine: x86_64 Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: clock source: unix Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: pcre jit disabled Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: detected number of CPU cores: 4 Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: current working directory: / Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: detected binary path: /usr/bin/uwsgi-core Oct 10 11:50:34.437282 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: your processes number limit is 47680 Oct 10 11:50:34.438054 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: your memory page size is 4096 bytes Oct 10 11:50:34.438054 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: detected max file descriptor number: 2048 Oct 10 11:50:34.438054 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: lock engine: pthread robust mutexes Oct 10 11:50:34.438054 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: thunder lock: enabled Oct 10 11:50:34.438054 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 11:50:34.438054 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 11:50:34.476767 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: Python main interpreter initialized at 0x558db46fb9c0 Oct 10 11:50:34.476767 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: python threads support enabled Oct 10 11:50:34.476767 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: your server socket listen backlog is limited to 100 connections Oct 10 11:50:34.476767 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: your mercy for graceful operations on workers is 90 seconds Oct 10 11:50:34.477097 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 11:50:34.477202 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: *** Operational MODE: preforking *** Oct 10 11:50:34.477454 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: *** uWSGI is running in multiple interpreter mode *** Oct 10 11:50:34.477454 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: spawned uWSGI master process (pid: 105478) Oct 10 11:50:34.477629 dv-cinder-850618-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 10 11:50:34.480850 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: spawned uWSGI worker 1 (pid: 105479, cores: 1) Oct 10 11:50:34.480850 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: spawned uWSGI worker 2 (pid: 105480, cores: 1) Oct 10 11:50:34.480850 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 11:50:35.130673 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 11:50:35.147230 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 11:50:36.206217 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:50:36.206217 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: from cryptography.utils import int_from_bytes Oct 10 11:50:36.206987 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:50:36.206987 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: from cryptography.utils import int_from_bytes Oct 10 11:50:36.207430 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:50:36.207430 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: from cryptography.utils import int_from_bytes Oct 10 11:50:36.207589 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:50:36.207589 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: from cryptography.utils import int_from_bytes Oct 10 11:50:38.656874 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:50:38.657394 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:50:38.657735 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:50:38.657838 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:50:38.657922 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:50:38.657998 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:50:38.658091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:50:38.658171 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:50:38.658259 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:50:38.658345 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:50:38.658499 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.658588 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.658814 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.658922 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.659151 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.659265 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.659463 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.659566 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.659779 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.659884 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.660088 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.660183 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.660389 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.660493 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.660696 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.660794 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661012 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661118 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661272 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661375 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661577 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661682 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661892 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-4-iscsi {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.661977 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-4-iscsi {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.662245 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.662340 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.662497 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.662585 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.662798 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.662883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.663127 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.663211 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.663423 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.663516 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.663735 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.663819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.664035 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.664128 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.664513 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.664616 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.665654 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.665790 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.665790 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.665990 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666071 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666203 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666293 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666381 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666518 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666600 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666689 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666775 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.666857 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.667006 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.667110 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.667192 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.667354 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.667440 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.667656 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.667760 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.668039 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-4-iscsi {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.668132 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-4-iscsi {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.668397 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.668971 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.669189 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.669314 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.669493 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.669626 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.669897 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.670033 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.670210 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.670398 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.670483 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.670631 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.670795 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.670969 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.671131 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.671289 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.671433 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.671591 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.671751 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.671913 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.672061 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.672226 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.672371 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.672539 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.672681 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.672850 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.673019 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.673146 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.673262 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.673448 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.673562 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.673750 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.673870 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.674059 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.674154 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.674360 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.674446 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.674657 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.674752 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.674921 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.675069 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.675233 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.675324 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.675550 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.675654 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.675862 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.675950 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.676112 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.676210 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.676356 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.676446 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.676666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.676761 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.676963 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.677059 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.677264 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.677358 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.677565 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.677658 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.677861 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.677957 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.678160 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.678245 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.678456 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.678540 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.678755 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.678841 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.679073 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.679173 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.679372 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.679460 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.679672 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.679774 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.679977 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.680071 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.680301 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.680391 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.680575 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.680669 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.680883 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.680970 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.681197 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.681283 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.681498 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.681591 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.681797 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.681885 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.682109 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.682195 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.682676 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.682769 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.682999 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.683091 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.683310 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.683411 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.683622 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.683708 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.683938 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.684507 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.684726 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.684825 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.685028 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.685111 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.685332 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.685427 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.685648 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.685751 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.685943 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.686029 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.686187 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.686281 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.686479 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.686573 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.686774 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.686862 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.687098 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.687246 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.687410 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.687552 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.687713 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.687854 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.688016 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.688163 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.688318 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.688456 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.688612 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.688756 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.688914 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.689055 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.689214 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.689355 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.689513 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.689654 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.689814 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.689951 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.690118 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.690237 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.690418 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.690534 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.690718 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.690832 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.691043 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.691154 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.691344 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.691454 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.691643 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.691751 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.691957 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.692045 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.692271 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.692356 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.692573 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.692669 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.692872 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.692973 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.693172 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.693260 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.693472 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.693559 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.693777 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.693864 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.694074 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.694162 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.694371 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.694456 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.694670 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.694757 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.694986 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.695077 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.695288 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.695386 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.695585 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.695672 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.695883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.695980 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.696182 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.696280 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.696470 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.696556 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.696768 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.696854 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.697066 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.697164 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.697359 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.697445 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.697656 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.697742 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.697951 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.698047 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.698247 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.698333 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.698540 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.698632 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.698837 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.698963 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.699153 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.699240 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.699448 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.699541 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.700303 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.700405 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.700598 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.700698 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.700912 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.700999 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.701213 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.701300 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.701511 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.701598 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.701807 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.701895 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.702104 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.702198 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.702418 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:50:38.702506 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.702738 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.702832 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.703090 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.703189 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.703396 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.703484 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.703721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.703818 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.704043 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.704130 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.704356 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.704448 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.704662 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.704756 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.704969 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.705054 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.705281 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.705416 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.705586 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.705674 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.705890 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.705978 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.706195 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.706288 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.706505 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.706592 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.706818 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.706934 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.707159 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.707255 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.707468 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.707555 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.707778 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.707866 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.708088 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.708182 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.708396 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.708484 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.708702 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.708789 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.709015 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.709102 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.709329 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.709416 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.709634 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.709728 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.709941 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.710035 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.710280 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.710407 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.710585 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.710730 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.710992 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.711100 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.711232 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.711321 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.711537 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.711626 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.711844 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.711939 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.712149 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.712248 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.712483 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.712571 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.712788 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.712884 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.713093 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.713180 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.713402 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.713486 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.713703 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.713797 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.714013 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.714098 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.714316 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.714410 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.714617 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.714716 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.714939 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.715031 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.715275 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.715384 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.715580 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.715672 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.715888 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.715976 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.716200 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.716287 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.716515 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.716602 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.716824 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.716920 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.717130 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.717217 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.717436 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.717524 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.717738 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.717823 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.718041 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.718127 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.718346 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.718433 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.718641 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.718733 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.718959 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.719062 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.719256 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.719350 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.719552 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.719638 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.719846 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.719941 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.720142 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.720228 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.720456 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.720543 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.720753 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.720861 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.721065 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.721158 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.721362 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.721448 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.721666 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.721770 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.721970 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.722063 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.722271 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.722357 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.722569 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.722659 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.722866 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.722978 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.723192 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.723280 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.723492 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.723587 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.723805 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.723898 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.724097 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.724190 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.724395 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.724484 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.724693 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.724787 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.724992 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.725080 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.725292 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.725381 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.725594 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.725680 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.725896 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.725991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.726199 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.726285 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.726507 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.726602 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.726810 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.726938 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.727140 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.727235 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.727441 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.727526 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.727744 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.727846 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.728049 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.728134 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.728379 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.728466 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.728676 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.728771 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.728990 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.729078 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.729305 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.729400 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.729611 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.729699 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.729907 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.729996 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.730204 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.730297 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.730497 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.730634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.731316 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.731415 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.731616 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.731704 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.731912 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.731999 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.732205 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.732303 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.732501 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.732603 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.732794 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.732883 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.733090 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.733180 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.733384 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.733483 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.733681 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.733767 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.733984 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.734070 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.734277 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.734379 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.734570 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.734658 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.734865 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.734974 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.735183 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.735289 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.735502 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.735587 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.735811 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.735899 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.736142 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.736237 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.736451 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.736538 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.736763 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.736851 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.737068 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.737156 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.737375 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.737459 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.737674 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.737759 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.737977 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.738065 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.738279 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.738366 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.738583 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.738674 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.738920 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.739012 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.739211 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.739296 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.739514 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.739611 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.739815 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.739910 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.740122 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.740208 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.740421 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.740506 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.740732 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.740863 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.741022 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.741117 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.741328 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.741465 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.741636 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.741722 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.741965 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.742050 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.742273 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.742380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.742585 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.742674 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.742937 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.743042 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.743210 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.743307 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.743513 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.743600 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.743816 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.743902 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.744114 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.744213 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.744414 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.744501 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.744716 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.744812 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.745014 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.745101 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.745318 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.745411 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.745618 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.745704 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.745922 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.746018 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.746218 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.746303 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.747097 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.747205 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.747414 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.747503 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.747714 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.747801 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.748024 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.748119 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.748346 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.748434 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.748652 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.748739 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.748959 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.749045 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.749265 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.749352 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.749567 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.749663 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.749865 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.749965 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.750166 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.750252 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.750459 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.750548 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.750754 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.750934 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.751077 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.751166 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.751380 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.751465 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.751684 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.751853 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.751984 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.752072 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.752280 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.752366 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.752576 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.752670 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.752872 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.752967 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.753165 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.753259 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.753459 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.753546 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.753753 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.753838 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.754058 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.754144 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.754357 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.754444 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.754662 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.754747 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.754992 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.755093 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.755290 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.755380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.755586 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.755679 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.755883 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.755971 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.756186 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.756280 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.756480 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.756574 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.756776 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.756872 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.757072 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.757158 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.757371 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.757456 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.757699 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.757802 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.757994 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.758089 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.758291 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.758376 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.758601 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.758695 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.758953 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.759057 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.759230 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.759342 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.759529 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.759624 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.759828 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.759922 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.760130 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.760215 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.760434 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.760529 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.760734 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.760830 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.761035 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.761128 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.761336 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.761471 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.761639 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.761728 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.761941 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.762026 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.762272 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.762361 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.762571 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.762696 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.762874 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.763018 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.763203 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.763291 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.763496 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.763590 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.763795 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.763890 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.764101 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.764188 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.764414 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.764655 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.764966 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.765061 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.765275 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.765362 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.765586 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.765673 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.765898 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.765997 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.766221 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.766320 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.766530 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.766626 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.766848 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.766987 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.767177 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.767282 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.767478 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.767566 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.767778 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.767865 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.768075 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.768169 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.768371 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.768460 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.768667 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.768752 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.768961 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.769062 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.769257 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.769345 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.769553 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.769638 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.769851 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.769947 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.770143 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.770229 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.770438 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.770524 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.770732 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.770820 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.771048 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.771142 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.771346 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.771433 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.771642 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.771743 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.771944 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.772039 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.772236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.772321 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.772533 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.772620 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.772834 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.772919 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.773128 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.773215 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.773423 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.773511 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.773716 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.773810 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.774013 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.774109 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.774330 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.774417 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.774639 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.774732 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.774991 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.775166 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.775314 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.775408 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.775607 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.775694 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.775902 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.775999 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.776215 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.776303 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.776511 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.776612 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.776807 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.776904 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.777101 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.777196 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.777395 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.777481 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.777712 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.777807 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778009 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778097 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778302 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778387 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778599 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778687 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778909 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.778999 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.779221 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.779310 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.779514 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.779602 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.779808 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.779902 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.780101 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.780188 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.780395 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.780524 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.780692 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.780778 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.780986 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.781167 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.781280 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.781368 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.781572 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.781657 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.781866 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.781968 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.782159 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.782246 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.782452 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.782537 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.782742 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.782838 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.783066 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.783161 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.783355 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.783442 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.783649 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.783749 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.783941 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.784037 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.784236 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.784323 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.784531 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.784626 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.784824 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.784912 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.785118 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.785204 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.785422 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.785524 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.785716 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.785812 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.786008 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.786096 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.786303 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.786391 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.786592 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.786685 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.786885 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.787013 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.787203 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.787300 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.787506 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.787592 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.787808 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.787902 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.788101 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.788196 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.788400 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.788488 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.788699 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.788795 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.788993 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.789085 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.789283 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.789369 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.789576 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.789671 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.789866 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.789951 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.790158 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.790245 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.790448 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.790546 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.790741 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.790840 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.791055 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.791142 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.791349 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.791439 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.791653 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.791741 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.791947 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.792040 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.792240 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.792336 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.792536 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.792630 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.792834 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.792921 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.793157 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.793252 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.793979 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.794065 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.794316 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.794403 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.794621 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.794709 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.794950 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.795043 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.795257 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.795361 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.795563 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.795651 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.795869 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.795954 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.796162 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.796265 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.796466 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.796552 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.796769 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.796856 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.797074 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.797173 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.797371 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.797458 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.797665 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.797759 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.797960 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.798059 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.798266 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.798354 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.798567 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.798661 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.798871 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.799040 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.799203 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.799302 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.799515 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.799601 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.799808 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.799896 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.800108 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.800204 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.800409 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.800494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.800705 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.800793 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801007 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801107 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801307 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801407 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801608 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801695 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801909 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.801995 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.802213 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.802316 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.802511 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.802599 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.802813 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.802960 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.803136 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.803341 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.803442 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.803526 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.803724 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.803813 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.804018 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.804123 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.804315 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.804401 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.804622 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.804706 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.804919 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.805013 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.805214 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.805300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.805508 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.805594 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.805803 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.805896 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.806097 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.806186 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.806393 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.806509 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.806811 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.806989 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.807137 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.807222 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.807687 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.807788 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.807992 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.808080 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.808296 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.808382 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.808608 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.808693 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.808977 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.809063 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.809791 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.809884 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.810092 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.810274 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.810502 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.810591 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.810813 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.810932 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.811142 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.811243 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.811453 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.811553 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.811751 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.811836 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.812048 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.812155 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.812356 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.812455 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.812645 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.812731 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.812943 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.813041 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.813241 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.813340 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.813536 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.813621 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.813833 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.813934 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.814137 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.814222 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.814451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.814546 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.814825 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.814941 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.815150 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.815261 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.815461 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.815554 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.815841 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.815928 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.816145 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.816231 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.816457 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.816554 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.816771 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.816866 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.817086 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.817174 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.817385 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.817471 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.817687 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.817774 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.817988 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.818081 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.818294 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.818380 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.818604 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.818688 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.818927 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.819052 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.819237 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.819335 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.819531 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.819637 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.819837 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.819943 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.820148 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.820289 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.820454 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.820597 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.820763 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.820901 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.821081 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.821216 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.821462 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.821610 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.821765 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.821862 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.822076 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.822164 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.822390 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.822478 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.822684 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.822771 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.822999 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.823091 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.823302 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.823392 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.823600 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.823697 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.823899 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.824007 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.824198 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.824301 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.824492 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.824595 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.824815 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.824911 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.825117 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.825215 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.825417 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.825513 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.825712 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.825809 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.826007 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.826102 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.826306 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.826415 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.826598 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.826702 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.826932 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.827030 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.827230 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.827329 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.827543 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.827643 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.827853 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.827939 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.828151 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.828239 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.828453 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.828548 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.828757 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.828851 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.829054 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.829140 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.829348 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.829444 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.829640 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.829728 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.829935 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.830021 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.830259 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.830345 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.830558 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.830644 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.830874 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.831036 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.831222 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.831310 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.831526 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.831667 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.831836 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.831929 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.832156 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.832256 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.832472 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.832618 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.832777 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.832877 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.833083 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.833169 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.833395 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.833484 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.833689 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.833790 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.833984 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.834071 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.834286 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.834373 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.834583 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.834679 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.834878 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.834990 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.835194 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.835284 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.835491 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.835587 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.835782 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.835877 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.836075 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.836164 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.836369 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.836458 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.836664 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.836751 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.836963 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.837050 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.837272 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.837367 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.837571 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.837657 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.837868 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.837959 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.838163 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.838252 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.838457 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.838545 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.838753 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.838839 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.839117 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.839209 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.839418 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.839513 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.839724 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.839819 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.840034 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.840120 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.840364 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.840450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.840674 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.840770 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.840984 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.841138 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.841293 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.841381 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.841600 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.841716 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.841910 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.842011 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.842215 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.842302 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.842515 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.842648 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.842820 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.842940 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.843147 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.843236 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.843455 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.843597 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.843769 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.843961 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.844282 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.844369 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.844586 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.844681 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.844891 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.844979 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.845196 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.845284 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.845501 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.845591 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.845804 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.845891 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.846109 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.846197 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.846414 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.846502 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.846712 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.846805 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.847052 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.847163 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.847363 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.847452 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.847679 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.847774 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.847994 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.848090 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.848314 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.848403 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.848623 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.848710 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.848929 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.849018 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.849235 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.849323 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.849539 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.849627 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.849847 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.849936 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.850182 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.850267 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.850482 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.850583 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.850783 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.850871 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.851113 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.851238 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.851423 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.851529 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.851726 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.851820 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.852033 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.852133 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.852337 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.852434 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.852637 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.852721 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.852941 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.853038 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.853244 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.853345 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.853544 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.853670 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.853848 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.853934 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.854156 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.854245 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.854476 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.854563 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.854788 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.854874 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.855117 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.855209 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.855421 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.855509 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.855726 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.856337 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.856571 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.856758 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.857066 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.857153 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.857385 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.857544 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.857700 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.857833 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.858015 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.858104 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.858324 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.858421 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.858632 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.858720 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.858967 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.859058 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.859274 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.859373 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.859572 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.859664 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.859874 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.859970 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.860174 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.860270 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.860469 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.860566 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.860768 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.860863 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.861070 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.861157 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.861364 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.861451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.861668 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.861807 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.861967 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.862069 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.862279 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.862489 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.862801 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.862972 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.863150 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.863240 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.863463 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.863549 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.863778 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.863873 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.864087 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.864182 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.864386 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.864473 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.864685 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.864781 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.864988 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.865075 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.865288 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.865376 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.865589 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.865689 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.865891 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.865986 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.866190 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.866277 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.866485 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.866585 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.866782 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.866867 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.867107 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.867197 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.867406 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.867496 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.867707 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.867793 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868002 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868089 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868302 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868397 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868606 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868692 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868905 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.868991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.869204 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.869292 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.869503 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.869597 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.869797 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.869882 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.870091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.870188 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.870388 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.870481 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.870681 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.870777 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.871002 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.871093 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.871300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.871402 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.872154 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.872283 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.872453 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.872544 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.872753 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.872839 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.873062 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.873167 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.873388 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.873476 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.873686 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.873774 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.873989 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.874093 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.874283 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.874377 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.874579 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.874667 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.874881 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.875022 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.875206 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.875292 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.875510 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.875605 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.875816 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.875904 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.876120 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.876206 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.876423 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.876518 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.876752 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.876846 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.877068 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.877331 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.877659 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.877982 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.878306 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.878453 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.878627 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.878788 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.878990 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.879153 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.879302 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.879443 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.879594 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.879747 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.879889 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.880050 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.880212 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.880357 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.880519 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.880672 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.880822 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.880994 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.881147 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.881297 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.881457 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.881675 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.881824 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.881984 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.882200 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.882370 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.882590 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.882740 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.882932 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.883085 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.883235 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.883374 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.883525 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.883670 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.883837 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.884050 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.884205 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.884355 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.884517 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.884668 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.884831 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.884985 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.885133 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.885280 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.885434 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.885592 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.885757 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.885907 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.886058 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.886221 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.886370 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.886540 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.886690 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.886838 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887043 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887197 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887348 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887605 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887734 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887808 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887874 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.887939 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888014 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888083 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888156 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888223 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888289 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888395 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888644 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888803 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.888928 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.889014 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.889233 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.889331 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.889596 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.889892 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.889982 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.890205 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.890300 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.890522 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.890610 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.890828 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.890971 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.891168 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.891255 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.891472 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.891569 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.891794 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.891898 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.892100 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.892237 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.892420 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.892510 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.892730 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.892835 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.893026 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.893122 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.893327 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.893424 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.893625 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.893713 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.893929 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.894026 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.894240 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.894328 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.894544 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.894634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.894843 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.894963 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.895162 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.895251 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.895465 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.895552 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.895762 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.895860 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.896058 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.896146 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.896353 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.896439 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.896646 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.896742 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.896946 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.897032 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.897238 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.897331 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.897532 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.897630 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.897828 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.897914 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.898120 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.898214 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.898414 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.898547 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.898708 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.898797 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.899036 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.899140 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.899338 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.899428 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.899632 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.899720 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.899927 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.900023 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.900223 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.900310 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.900517 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.900604 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.900821 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.900916 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.901121 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.901209 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.901421 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.901517 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.901720 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.901821 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.902025 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.902118 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.902338 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.902441 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.902657 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.902756 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.903015 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.903104 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.903328 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.903427 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.903647 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.903750 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.903952 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.904040 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.904270 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.904358 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.904569 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.904656 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.904873 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.904960 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.905176 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.905263 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.905479 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.905569 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.905782 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.905869 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.906082 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.906178 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.906389 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.906474 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.906695 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.906783 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.907065 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.907170 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.907324 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.907412 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.907628 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.907715 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.907936 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.908041 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.908242 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.908330 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.908544 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.908683 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.908857 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.908945 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.909159 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.909249 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.909462 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.909551 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.909763 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.909852 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.910066 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.910154 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.910367 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.910469 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.910671 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.910759 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.910995 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.911096 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.911299 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.911397 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.911604 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.911692 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.911908 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.912003 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.912210 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.912305 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.912518 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.912610 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.912830 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.912927 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.913141 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.913240 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.913455 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.913550 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.913774 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.913860 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.914080 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.914176 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.914399 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.914494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.914719 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.914806 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.915050 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.915140 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.915358 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.915452 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.915657 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.915744 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.915893 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:50:38.916012 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.916327 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.916637 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.916942 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:50:38.917184 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:50:39.068738 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Registered counter for database nova_api Oct 10 11:50:39.070724 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Registered counter for database nova_api Oct 10 11:50:39.089945 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.092238 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.096995 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.098652 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.151963 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.context [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6386297d-cd21-4182-a19e-d3837d7beef8(cell1) {{(pid=105479) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 11:50:39.154327 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.context [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6386297d-cd21-4182-a19e-d3837d7beef8(cell1) {{(pid=105480) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 11:50:39.156355 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.156828 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.158195 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.158359 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.158626 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.159110 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.159549 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.160187 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.160914 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.161357 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.161495 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.163342 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.163462 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Registered counter for database nova_cell0 Oct 10 11:50:39.165297 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Registered counter for database nova_cell0 Oct 10 11:50:39.167711 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Registered counter for database nova_cell1 Oct 10 11:50:39.169757 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Registered counter for database nova_cell1 Oct 10 11:50:39.175362 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.176945 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.179079 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.180770 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.183333 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.185629 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.186478 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.191596 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.327649 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Registered counter for database nova_cell0 Oct 10 11:50:39.330547 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Registered counter for database nova_cell0 Oct 10 11:50:39.336431 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.339900 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:50:39.341567 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.345176 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:50:39.676341 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:50:39.677138 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:50:39.683999 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:50:39.685022 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:50:40.021385 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:50:40.023232 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:50:40.027257 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:50:40.029709 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:50:40.032990 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558db46fb9c0 pid: 105480 (default app) Oct 10 11:50:40.035262 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:40.035756 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558db46fb9c0 pid: 105479 (default app) Oct 10 11:50:40.036444 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-d144a97e-a1ef-413b-a5dc-4961c88c3a48 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001950 Oct 10 11:50:40.036852 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Mon Oct 10 11:50:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:00.744330 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:00.745389 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002545 Oct 10 11:52:00.745785 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:00.761870 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=3 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:00.763002 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell0:SELECT=3 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:00.763851 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell1:SELECT=3 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:00.764851 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:01.641896 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-f64f6552-d3c1-4e11-ab17-3e5142ffd8d5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:01.673589 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-f64f6552-d3c1-4e11-ab17-3e5142ffd8d5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921731 Oct 10 11:52:01.675023 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Oct 10 11:52:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:04.273464 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:04.274471 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-3641b89a-9074-4a28-a574-3ee486a09d8b None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 10 11:52:04.279222 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:04.732362 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-d3ad30e9-0e6b-45ef-a79d-61374619795e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "ram": 256, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:04.780080 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-d3ad30e9-0e6b-45ef-a79d-61374619795e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.499127 Oct 10 11:52:04.780667 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:52:04.795007 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:04.795821 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell1:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:04.796780 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell0:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:04.797509 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:05.007187 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-dd76c80c-9469-4932-a422-de3e3457c02d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:05.076270 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-dd76c80c-9469-4932-a422-de3e3457c02d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287117 Oct 10 11:52:05.076847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Oct 10 11:52:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:07.713139 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-d3ad30e9-0e6b-45ef-a79d-61374619795e admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:07.714161 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-d3ad30e9-0e6b-45ef-a79d-61374619795e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Oct 10 11:52:07.714573 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:08.357040 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-82785898-963f-401d-a37c-d9f54472ee1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "swap": 0}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:08.399685 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-82785898-963f-401d-a37c-d9f54472ee1a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.678935 Oct 10 11:52:08.405415 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:52:08.412879 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-801f5286-af7c-4a85-b158-eefe4937139d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:08.456712 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-801f5286-af7c-4a85-b158-eefe4937139d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047429 Oct 10 11:52:08.457470 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Oct 10 11:52:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:52:11.063300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-82785898-963f-401d-a37c-d9f54472ee1a admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:11.064321 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-82785898-963f-401d-a37c-d9f54472ee1a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 10 11:52:11.064916 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:11.484274 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-4215568b-562e-4b41-bac9-125ac188617d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "vcpus": 1}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:11.503367 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-4215568b-562e-4b41-bac9-125ac188617d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431561 Oct 10 11:52:11.503910 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:52:11.516215 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-5a9d28a5-b363-4ec1-89a6-ab44edd5b950 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:11.544558 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-5a9d28a5-b363-4ec1-89a6-ab44edd5b950 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032006 Oct 10 11:52:11.545199 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Oct 10 11:52:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:14.132441 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-4215568b-562e-4b41-bac9-125ac188617d admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:14.133443 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-4215568b-562e-4b41-bac9-125ac188617d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 10 11:52:14.133867 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:14.549453 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-719da13e-4980-4c80-8083-12b8b44fcebe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:14.571850 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-719da13e-4980-4c80-8083-12b8b44fcebe admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431648 Oct 10 11:52:14.573011 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:52:14.584743 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-89c6d443-d443-482c-8498-66c9e95775d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:14.614524 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-89c6d443-d443-482c-8498-66c9e95775d0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033360 Oct 10 11:52:14.615604 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Oct 10 11:52:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:17.260992 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-719da13e-4980-4c80-8083-12b8b44fcebe admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:17.262195 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-719da13e-4980-4c80-8083-12b8b44fcebe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001863 Oct 10 11:52:17.262720 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:17.696943 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-5a7db2db-397f-439f-b693-72b470cf790a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "name": "ds4G"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:17.716126 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-5a7db2db-397f-439f-b693-72b470cf790a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446277 Oct 10 11:52:17.716667 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:52:17.731436 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-3450da74-5530-4c6f-b082-e68f9f1dc33d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:17.760773 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-3450da74-5530-4c6f-b082-e68f9f1dc33d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033702 Oct 10 11:52:17.761492 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Oct 10 11:52:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:20.342077 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-5a7db2db-397f-439f-b693-72b470cf790a admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:20.343211 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-5a7db2db-397f-439f-b693-72b470cf790a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 10 11:52:20.343608 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:20.758025 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-86a331b9-f770-4265-b764-e19a79d7a8e0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:20.783041 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-86a331b9-f770-4265-b764-e19a79d7a8e0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.433430 Oct 10 11:52:20.783573 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Oct 10 11:52:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:52:23.789414 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-5a7db2db-397f-439f-b693-72b470cf790a admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:23.791678 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-5a7db2db-397f-439f-b693-72b470cf790a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002698 Oct 10 11:52:23.792613 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:24.207111 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-8657607d-1a21-42a7-9849-c2ef3142a51b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:24.225750 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-8657607d-1a21-42a7-9849-c2ef3142a51b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426702 Oct 10 11:52:24.226287 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:52:24.238224 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-a09a4310-7bff-47e7-8d31-89b075f05cfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:24.265790 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-a09a4310-7bff-47e7-8d31-89b075f05cfe admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031112 Oct 10 11:52:24.266652 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Oct 10 11:52:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:26.856094 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-8657607d-1a21-42a7-9849-c2ef3142a51b admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:26.857094 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-8657607d-1a21-42a7-9849-c2ef3142a51b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 10 11:52:26.857494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:27.272583 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-566e8c95-4c59-411c-a531-3ee558623bc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "ram": 2048, "disk": 20}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:27.294170 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-566e8c95-4c59-411c-a531-3ee558623bc9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.430291 Oct 10 11:52:27.298971 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:52:27.307968 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-1a9e0057-6923-4fb5-a10e-61fe830afc59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:27.337360 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-1a9e0057-6923-4fb5-a10e-61fe830afc59 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033731 Oct 10 11:52:27.338042 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Oct 10 11:52:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:30.002151 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-566e8c95-4c59-411c-a531-3ee558623bc9 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:30.003167 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-566e8c95-4c59-411c-a531-3ee558623bc9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 10 11:52:30.003566 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:30.483860 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e24fc187-316e-41f1-987d-c78bd0cd274a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "vcpus": 2}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:30.510079 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e24fc187-316e-41f1-987d-c78bd0cd274a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.500358 Oct 10 11:52:30.510634 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:52:30.525347 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-379bd920-53ad-464e-8433-9c89631587df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:30.559530 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-379bd920-53ad-464e-8433-9c89631587df admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038610 Oct 10 11:52:30.560728 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Oct 10 11:52:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:33.175240 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e24fc187-316e-41f1-987d-c78bd0cd274a admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:33.177216 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e24fc187-316e-41f1-987d-c78bd0cd274a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002464 Oct 10 11:52:33.177896 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:33.617666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-098a221d-f1af-419b-be73-dda52cfc4979 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "disk": 80}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:33.625969 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:33.642630 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-098a221d-f1af-419b-be73-dda52cfc4979 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458081 Oct 10 11:52:33.643379 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:52:33.656048 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-bd0f8c54-6a04-4ed3-b941-a6fb415ef619 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:33.686242 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-bd0f8c54-6a04-4ed3-b941-a6fb415ef619 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034422 Oct 10 11:52:33.686975 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Oct 10 11:52:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:52:36.316243 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-098a221d-f1af-419b-be73-dda52cfc4979 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:36.317297 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-098a221d-f1af-419b-be73-dda52cfc4979 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 10 11:52:36.317701 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:36.763946 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-035fceb1-f44f-49ca-8758-ba2545587c88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:36.773162 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:36.788851 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-035fceb1-f44f-49ca-8758-ba2545587c88 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464394 Oct 10 11:52:36.789496 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Oct 10 11:52:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:52:36.802827 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-2ea6fb79-d45e-4f78-8ebe-178a23dac6c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:52:36.829526 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-2ea6fb79-d45e-4f78-8ebe-178a23dac6c7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031203 Oct 10 11:52:36.830157 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Oct 10 11:52:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:52:53.367711 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-035fceb1-f44f-49ca-8758-ba2545587c88 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:53.369237 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-035fceb1-f44f-49ca-8758-ba2545587c88 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 Oct 10 11:52:53.369633 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:53.380112 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:53.757201 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-e0473f15-9e91-4046-b395-8a97bda727e5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:53.776239 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-e0473f15-9e91-4046-b395-8a97bda727e5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400512 Oct 10 11:52:53.776769 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Oct 10 11:52:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:52:55.076119 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-035fceb1-f44f-49ca-8758-ba2545587c88 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:55.077122 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-035fceb1-f44f-49ca-8758-ba2545587c88 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Oct 10 11:52:55.077511 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:55.595661 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-02af301a-210b-4e31-8e5d-15fec39f8388 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:55.600889 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.wsgi [None req-02af301a-210b-4e31-8e5d-15fec39f8388 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-02af301a-210b-4e31-8e5d-15fec39f8388 admin admin] Request method failure captured: Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Accept: application/json Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Accept-Encoding: gzip, deflate Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Connection: keep-alive Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Content-Length: 0 Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Host: 10.222.0.52 Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Openstack-Api-Version: compute 2.92 Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Openstack-System-Scope: None Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: User-Agent: python-novaclient Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Auth-Token: gAAAAABjRAeWHySipvPA6e1ccbEsYCDsW7oqhXheDGRy5FrqJaRC30mekOktdO-QCe9loN94O2uatpVKoWi1ipc8g0ByKKVTTcRfm4h3ijkfMbTY2XKHNMqqXy9hcrewGvm3MRWcscFV0jA64X-wLCxyV-W2R1Ju2c2gK7Ml3WD15_5o_rAV_k4 Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Domain-Id: None Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Domain-Name: None Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Identity-Status: Confirmed Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Is-Admin-Project: True Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Domain-Id: default Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Domain-Name: Default Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Name: admin Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Role: member,admin,reader Oct 10 11:52:55.604723 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Roles: member,admin,reader Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_992fcf5a85d6497db94cb36327aec1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}] Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant: admin Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant-Name: admin Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User: admin Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Domain-Id: default Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Domain-Name: Default Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Id: 10d738bcb5484a248894a50e95518057 Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Name: admin Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: method: > Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: exception: Flavor 42 could not be found. Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: action_args: {'id': '42'} Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:52:55.606475 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:55.607450 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.608962 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-02af301a-210b-4e31-8e5d-15fec39f8388 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:52:55.610385 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-02af301a-210b-4e31-8e5d-15fec39f8388 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389691 Oct 10 11:52:55.610385 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Oct 10 11:52:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:55.616361 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-67b3df25-91f6-4adc-85f4-052807ebe03f admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:55.638596 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-67b3df25-91f6-4adc-85f4-052807ebe03f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026122 Oct 10 11:52:55.639176 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Oct 10 11:52:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:52:55.649897 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-1eea9fc0-0a3b-49a9-86bc-02d913f884bb admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:55.671729 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-1eea9fc0-0a3b-49a9-86bc-02d913f884bb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026646 Oct 10 11:52:55.672243 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Oct 10 11:52:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:52:55.681564 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-55058d5c-644a-42a8-8ac5-6878030f163f admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:55.686848 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-55058d5c-644a-42a8-8ac5-6878030f163f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-55058d5c-644a-42a8-8ac5-6878030f163f admin admin] Request method failure captured: Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Accept: application/json Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Connection: keep-alive Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Content-Length: 0 Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Host: 10.222.0.52 Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.92 Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABjRAeWHySipvPA6e1ccbEsYCDsW7oqhXheDGRy5FrqJaRC30mekOktdO-QCe9loN94O2uatpVKoWi1ipc8g0ByKKVTTcRfm4h3ijkfMbTY2XKHNMqqXy9hcrewGvm3MRWcscFV0jA64X-wLCxyV-W2R1Ju2c2gK7Ml3WD15_5o_rAV_k4 Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Role: member,admin,reader Oct 10 11:52:55.690091 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Roles: member,admin,reader Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_992fcf5a85d6497db94cb36327aec1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}] Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant: admin Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User: admin Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Id: 10d738bcb5484a248894a50e95518057 Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Name: admin Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: method: > Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: exception: Flavor 42 could not be found. Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: action_args: {'id': '42'} Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:52:55.691576 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:55.692494 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:55.693721 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-55058d5c-644a-42a8-8ac5-6878030f163f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:52:55.694746 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-55058d5c-644a-42a8-8ac5-6878030f163f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013719 Oct 10 11:52:55.694746 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Oct 10 11:52:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:56.899777 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-1eea9fc0-0a3b-49a9-86bc-02d913f884bb admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:56.900821 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-1eea9fc0-0a3b-49a9-86bc-02d913f884bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 10 11:52:56.901221 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:52:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:57.419853 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-844c15b5-f20d-4f9f-9482-2dc9510c3fc0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:57.424844 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-844c15b5-f20d-4f9f-9482-2dc9510c3fc0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-844c15b5-f20d-4f9f-9482-2dc9510c3fc0 admin admin] Request method failure captured: Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Accept: application/json Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Connection: keep-alive Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Content-Length: 0 Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Host: 10.222.0.52 Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.92 Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABjRAeYOQn_wt-B0MdcrFGckf-61uSEZRXH8CeFfi9bZy8ZVVs_RqyiqZ9enjALsk6pp6KSP6R415TZW6sxhqxgdm4-VNpHGF2R4ObiSWE44PWzI_YQ2qhbgy2gFXXTAhHOXMXZ4i2hHlArwh_SmLMEdnC0qvG_uTwP7JWP_SVjGbD4Zjc Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Role: member,admin,reader Oct 10 11:52:57.426326 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Roles: member,admin,reader Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_992fcf5a85d6497db94cb36327aec1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}] Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant: admin Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User: admin Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Id: 10d738bcb5484a248894a50e95518057 Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Name: admin Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: method: > Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: exception: Flavor 84 could not be found. Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: action_args: {'id': '84'} Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:52:57.427883 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:57.428847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.430565 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-844c15b5-f20d-4f9f-9482-2dc9510c3fc0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:52:57.431915 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-844c15b5-f20d-4f9f-9482-2dc9510c3fc0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387980 Oct 10 11:52:57.431915 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Oct 10 11:52:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:57.437725 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-9978a8a4-97b0-404d-92bd-07383fef43da admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:57.453057 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-9978a8a4-97b0-404d-92bd-07383fef43da admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019025 Oct 10 11:52:57.453573 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Oct 10 11:52:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:52:57.463199 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-1a8c1301-3411-4c46-bbd0-d9c13f335429 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:57.478103 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-1a8c1301-3411-4c46-bbd0-d9c13f335429 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018893 Oct 10 11:52:57.478617 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Oct 10 11:52:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:52:57.487502 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-c237b785-2e66-4dac-b31c-d865f47fdd90 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:57.492298 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.wsgi [None req-c237b785-2e66-4dac-b31c-d865f47fdd90 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-c237b785-2e66-4dac-b31c-d865f47fdd90 admin admin] Request method failure captured: Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Accept: application/json Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Accept-Encoding: gzip, deflate Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Connection: keep-alive Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Content-Length: 0 Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Host: 10.222.0.52 Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Openstack-Api-Version: compute 2.92 Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Openstack-System-Scope: None Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: User-Agent: python-novaclient Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Auth-Token: gAAAAABjRAeYOQn_wt-B0MdcrFGckf-61uSEZRXH8CeFfi9bZy8ZVVs_RqyiqZ9enjALsk6pp6KSP6R415TZW6sxhqxgdm4-VNpHGF2R4ObiSWE44PWzI_YQ2qhbgy2gFXXTAhHOXMXZ4i2hHlArwh_SmLMEdnC0qvG_uTwP7JWP_SVjGbD4Zjc Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Domain-Id: None Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Domain-Name: None Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Identity-Status: Confirmed Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Is-Admin-Project: True Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Domain-Id: default Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Domain-Name: Default Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Name: admin Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Role: member,admin,reader Oct 10 11:52:57.493780 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Roles: member,admin,reader Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_992fcf5a85d6497db94cb36327aec1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}] Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant: admin Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant-Name: admin Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User: admin Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Domain-Id: default Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Domain-Name: Default Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Id: 10d738bcb5484a248894a50e95518057 Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Name: admin Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: method: > Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: exception: Flavor 84 could not be found. Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: action_args: {'id': '84'} Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:52:57.496451 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:57.497380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:57.498666 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-c237b785-2e66-4dac-b31c-d865f47fdd90 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:52:57.500047 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-c237b785-2e66-4dac-b31c-d865f47fdd90 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011041 Oct 10 11:52:57.500047 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Oct 10 11:52:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 11:52:58.829656 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-1a8c1301-3411-4c46-bbd0-d9c13f335429 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:58.830682 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-1a8c1301-3411-4c46-bbd0-d9c13f335429 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 10 11:52:58.831103 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:52:59.347806 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-53a5f6e8-7ccd-4af6-9e5d-7d3f9e26601b admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:59.354588 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.wsgi [None req-53a5f6e8-7ccd-4af6-9e5d-7d3f9e26601b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-53a5f6e8-7ccd-4af6-9e5d-7d3f9e26601b admin admin] Request method failure captured: Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Accept: application/json Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Accept-Encoding: gzip, deflate Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Connection: keep-alive Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Content-Length: 0 Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Host: 10.222.0.52 Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Openstack-Api-Version: compute 2.92 Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Openstack-System-Scope: None Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: User-Agent: python-novaclient Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Auth-Token: gAAAAABjRAeaFnK9k3vB8FLdcHdiFie18n7sLtX6-AoOEEkOTM2N6IL313culEyrqPIq-qG067pVoBHYs9JEZoYSzm0ZHxDA0UIoAxwjpvvGuYx56TOmnAHXLvTKG2h6l4mYhRZNX3_lj-5fqqxLcp4RO1rVQSnh_cOZyhO9-7NUGftAXUujcWY Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Domain-Id: None Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Domain-Name: None Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Identity-Status: Confirmed Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Is-Admin-Project: True Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Domain-Id: default Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Domain-Name: Default Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Project-Name: admin Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Role: member,admin,reader Oct 10 11:52:59.356110 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Roles: member,admin,reader Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_992fcf5a85d6497db94cb36327aec1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}] Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant: admin Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-Tenant-Name: admin Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User: admin Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Domain-Id: default Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Domain-Name: Default Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Id: 10d738bcb5484a248894a50e95518057 Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: X-User-Name: admin Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: method: > Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: exception: Flavor 451 could not be found. Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: action_args: {'id': '451'} Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:52:59.357634 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:59.358640 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.359991 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-53a5f6e8-7ccd-4af6-9e5d-7d3f9e26601b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:52:59.361270 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-53a5f6e8-7ccd-4af6-9e5d-7d3f9e26601b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390841 Oct 10 11:52:59.361270 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Oct 10 11:52:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:59.367458 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-82a5635f-ad6f-47a2-801f-9138c3202de1 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:59.382960 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-82a5635f-ad6f-47a2-801f-9138c3202de1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018920 Oct 10 11:52:59.383497 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Oct 10 11:52:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:52:59.393260 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:59.407856 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018047 Oct 10 11:52:59.408391 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Oct 10 11:52:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:52:59.417782 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-c22c1642-d3e0-4f4c-84fa-9b981d2f4f65 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:52:59.422773 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-c22c1642-d3e0-4f4c-84fa-9b981d2f4f65 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-c22c1642-d3e0-4f4c-84fa-9b981d2f4f65 admin admin] Request method failure captured: Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Accept: application/json Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Connection: keep-alive Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Content-Length: 0 Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Host: 10.222.0.52 Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.92 Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABjRAeaFnK9k3vB8FLdcHdiFie18n7sLtX6-AoOEEkOTM2N6IL313culEyrqPIq-qG067pVoBHYs9JEZoYSzm0ZHxDA0UIoAxwjpvvGuYx56TOmnAHXLvTKG2h6l4mYhRZNX3_lj-5fqqxLcp4RO1rVQSnh_cOZyhO9-7NUGftAXUujcWY Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Role: member,admin,reader Oct 10 11:52:59.424300 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Roles: member,admin,reader Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_992fcf5a85d6497db94cb36327aec1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/992fcf5a85d6497db94cb36327aec1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/992fcf5a85d6497db94cb36327aec1f0"}]}] Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant: admin Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant-Id: 992fcf5a85d6497db94cb36327aec1f0 Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User: admin Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Id: 10d738bcb5484a248894a50e95518057 Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: X-User-Name: admin Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: method: > Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: exception: Flavor 451 could not be found. Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: action_args: {'id': '451'} Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:52:59.425887 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:59.426819 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Oct 10 11:52:59.428236 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-c22c1642-d3e0-4f4c-84fa-9b981d2f4f65 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:52:59.429478 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-c22c1642-d3e0-4f4c-84fa-9b981d2f4f65 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011519 Oct 10 11:52:59.429478 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Oct 10 11:52:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:00.646682 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:00.647821 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Oct 10 11:53:00.648219 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:53:01.164686 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-1b36790e-ca90-4f0a-9a9e-c869f8f80159 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:53:01.184431 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-1b36790e-ca90-4f0a-9a9e-c869f8f80159 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398710 Oct 10 11:53:01.184995 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Oct 10 11:53:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:53:02.402973 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:02.403983 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 10 11:53:02.404380 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:53:02.922842 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-ff785c32-f6e4-4968-abe2-3fccbc0aa23a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:53:02.941392 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-ff785c32-f6e4-4968-abe2-3fccbc0aa23a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399084 Oct 10 11:53:02.941947 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Oct 10 11:53:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:53:04.151449 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:04.152460 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 10 11:53:04.152853 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:53:04.666801 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-615eb469-4e55-453a-b189-5b91ff97d4aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:53:04.686134 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-615eb469-4e55-453a-b189-5b91ff97d4aa admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.397570 Oct 10 11:53:04.686665 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Oct 10 11:53:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:53:05.902539 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:05.903585 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 10 11:53:05.903983 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:53:06.427241 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e6fa3de5-4f6f-45dd-8845-91189e8e0083 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:53:06.445381 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e6fa3de5-4f6f-45dd-8845-91189e8e0083 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.403776 Oct 10 11:53:06.445950 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Oct 10 11:53:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:53:07.663143 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:07.664278 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Oct 10 11:53:07.664669 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:53:08.183811 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-72140763-5265-4f13-b3de-276557924821 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:08.203729 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-72140763-5265-4f13-b3de-276557924821 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401517 Oct 10 11:53:08.204260 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Mon Oct 10 11:53:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:54:04.372025 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:04.373011 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-23f0d191-e405-458e-88ad-7ba8952a4653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 10 11:54:04.373405 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 931 bytes} [Mon Oct 10 11:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:54:04.384054 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:04.760286 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-ef100799-e3d1-4ed6-8d9c-60982b9ec3fe admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:04.780724 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-ef100799-e3d1-4ed6-8d9c-60982b9ec3fe admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401202 Oct 10 11:54:04.781261 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Oct 10 11:54:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:54:04.801778 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=14 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:04.806641 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-075478af-e720-4ad2-a4d7-c4d4665041f6 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:04.814174 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-075478af-e720-4ad2-a4d7-c4d4665041f6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013807 Oct 10 11:54:04.814686 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1283 bytes} [Mon Oct 10 11:54:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:04.826628 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b1fbe79d-bdc4-4a1e-b38e-68c0853408e3 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:04.833660 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b1fbe79d-bdc4-4a1e-b38e-68c0853408e3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010591 Oct 10 11:54:04.834168 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1286 bytes} [Mon Oct 10 11:54:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:04.845712 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:04.852700 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010489 Oct 10 11:54:04.853249 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1286 bytes} [Mon Oct 10 11:54:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:04.863924 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-48328a81-f4b5-42b6-a7a4-bcf949bdded8 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:04.870794 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-48328a81-f4b5-42b6-a7a4-bcf949bdded8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010169 Oct 10 11:54:04.871334 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1283 bytes} [Mon Oct 10 11:54:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:57:04.710972 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:04.712035 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 10 11:57:04.712428 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:57:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:57:04.852692 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=6 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:57:05.009136 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:05.013804 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:05.014269 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:05.014695 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:05.015434 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:05.015879 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:05.016298 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:05.047301 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-89cebef4-7458-4ae4-99be-32cb96ac83ab admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.195706 Oct 10 11:57:05.047833 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Oct 10 11:57:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:57:06.130026 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:06.131064 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Oct 10 11:57:06.131456 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:57:06.320759 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:06.324731 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:06.325316 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:06.325747 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:06.326457 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:06.326928 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:06.327335 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:06.347648 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-580a6656-1611-4aac-ab51-4ef3617ba128 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077137 Oct 10 11:57:06.348310 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Oct 10 11:57:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:57:17.817159 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:17.818176 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Oct 10 11:57:17.818563 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:57:17.961750 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell0:SELECT=4 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:57:17.962457 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell1:SELECT=4 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:57:17.963317 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=8 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:57:18.011533 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:18.014847 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:18.015379 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:18.015831 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:18.016529 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:18.016969 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:18.017381 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:18.042161 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-c17eec38-2da0-45fd-b7ab-53158d3d4e12 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084188 Oct 10 11:57:18.042633 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Oct 10 11:57:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:57:19.104481 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:19.105486 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-0a7989c6-543b-43e3-b5dc-f7af159de4b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 Oct 10 11:57:19.105884 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Oct 10 11:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:57:19.295903 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:57:19.299301 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:19.299769 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:19.300213 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:19.300919 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:57:19.301360 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:57:19.301770 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:57:19.322838 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-690ed997-5fd3-4c33-bdd0-3dbe32ad1fdd admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.077617 Oct 10 11:57:19.323401 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Oct 10 11:57:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:58:17.270044 dv-cinder-850618-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 10 11:58:17.270549 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: Mon Oct 10 11:58:17 2022 - graceful shutdown triggered... Oct 10 11:58:17.271016 dv-cinder-850618-4-iscsi devstack@n-api.service[105479]: Gracefully killing worker 1 (pid: 105479)... Oct 10 11:58:17.271737 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: Gracefully killing worker 2 (pid: 105480)... Oct 10 11:58:17.397063 dv-cinder-850618-4-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=4 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:18.271536 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: worker 1 buried after 1 seconds Oct 10 11:58:18.272094 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: worker 2 buried after 1 seconds Oct 10 11:58:18.272094 dv-cinder-850618-4-iscsi devstack@n-api.service[105478]: goodbye to uWSGI. Oct 10 11:58:18.273113 dv-cinder-850618-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 10 11:58:18.273650 dv-cinder-850618-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 10 11:58:18.276989 dv-cinder-850618-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 11:58:18.287057 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 11:58:18 2022] *** Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: nodename: dv-cinder-850618-4-iscsi Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: machine: x86_64 Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: clock source: unix Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: pcre jit disabled Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: detected number of CPU cores: 4 Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: current working directory: / Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: detected binary path: /usr/bin/uwsgi-core Oct 10 11:58:18.289059 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: your processes number limit is 47680 Oct 10 11:58:18.289773 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: your memory page size is 4096 bytes Oct 10 11:58:18.289773 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: detected max file descriptor number: 2048 Oct 10 11:58:18.289773 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: lock engine: pthread robust mutexes Oct 10 11:58:18.289773 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: thunder lock: enabled Oct 10 11:58:18.289773 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 11:58:18.289773 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 11:58:18.329352 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: Python main interpreter initialized at 0x557a2488c9c0 Oct 10 11:58:18.329352 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: python threads support enabled Oct 10 11:58:18.329352 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: your server socket listen backlog is limited to 100 connections Oct 10 11:58:18.329352 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: your mercy for graceful operations on workers is 90 seconds Oct 10 11:58:18.329777 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 11:58:18.329777 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: *** Operational MODE: preforking *** Oct 10 11:58:18.330079 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: *** uWSGI is running in multiple interpreter mode *** Oct 10 11:58:18.330079 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: spawned uWSGI master process (pid: 120650) Oct 10 11:58:18.330305 dv-cinder-850618-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 10 11:58:18.330847 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: spawned uWSGI worker 1 (pid: 120662, cores: 1) Oct 10 11:58:18.331360 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: spawned uWSGI worker 2 (pid: 120663, cores: 1) Oct 10 11:58:18.339197 dv-cinder-850618-4-iscsi devstack@n-api.service[120650]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 11:58:18.990172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 11:58:18.990776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 11:58:20.147115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:20.147115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: from cryptography.utils import int_from_bytes Oct 10 11:58:20.147768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:20.147768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: from cryptography.utils import int_from_bytes Oct 10 11:58:20.154917 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:20.154917 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: from cryptography.utils import int_from_bytes Oct 10 11:58:20.155408 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:20.155408 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: from cryptography.utils import int_from_bytes Oct 10 11:58:22.589032 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:58:22.589548 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:58:22.589838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:58:22.591172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:58:22.591172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:58:22.591172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.591172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.591532 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.591744 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.592044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.592358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.592677 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.592992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.593317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.593556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:58:22.593935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.594010 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:58:22.594089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.594329 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-4-iscsi {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.594437 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:58:22.594654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.594755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:58:22.594968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:58:22.595083 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.595282 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.595389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.595606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.595706 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.595917 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.596026 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.596238 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.596337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.596552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.596661 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.596915 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.597084 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.597222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.597777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.598088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.598496 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.598674 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.598846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.599195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.599306 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.599486 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.599590 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.599789 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.599909 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.600124 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.600357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-4-iscsi {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.600597 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.600810 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.601077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.601291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.601509 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-4-iscsi {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.601731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.601952 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.602175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.602402 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.602613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.602830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.603078 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.603326 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.603547 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.603767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.603961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.604213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.604404 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.604570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.604785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.604945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605100 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.605999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.606294 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.606447 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.606620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-4-iscsi {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.606778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.606982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.607134 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.607289 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.607433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.607597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.607746 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.607912 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.608072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.608227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.608370 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.608537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.608693 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.608848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.609005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.609160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.609311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.609463 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.610220 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.610402 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.610561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.610714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.610867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.611083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.611237 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.611645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.611812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.611812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.612093 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.612247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.612394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.612562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.612716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.612871 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.613024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.613176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.613320 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.613473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.613624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.613768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.613912 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.614065 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.614222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.614384 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.614530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.614680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.614830 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.615000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.615300 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.615470 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.615626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.615626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.615902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.615902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.616309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.616493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.616643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.616796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.616940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.617164 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.617319 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.617319 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.617613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.617784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.617936 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.618090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.618234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.618388 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.618540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.618695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.618847 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.619032 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.619185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.619328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.619478 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.619629 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.619822 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.620444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.620612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.620757 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.620914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.621058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.621219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.621219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.621676 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.621676 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.622045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.622197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.622355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.622355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.622643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.622797 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.623028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.623199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.623353 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.623505 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.623657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.623801 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.623945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.624103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.624247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.624391 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.624540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.624683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.624834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.624992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.625158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.625311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.625465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.625617 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.625760 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.625920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.626072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.626217 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.626367 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.626518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.626669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.626821 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.626996 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.627153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.627298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.627450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.627601 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.627765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.627911 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.628053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.628198 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.628349 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.628507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.628652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.628806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.628960 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.629104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.629260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.629415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.629566 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.629709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.629865 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.630017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.630624 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.630790 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.630953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.631104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.631260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.631429 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.631592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.631878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.632135 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.632292 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.632448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.632595 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.632738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.632890 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.633034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.633185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.633346 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.633500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.633656 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.633814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.633969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.634121 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.634273 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.634426 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.634588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.634744 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.634905 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.635056 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.635199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.635861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.636028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.636191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.636343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.636486 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.636637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.636780 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.636932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.637084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.637228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.637371 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.637521 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.637681 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.637843 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.637998 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.638333 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.638497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.638644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.638797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.638979 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.639130 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.639287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.639430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.639580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.639739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.639884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.640027 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.640181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.640794 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.640958 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.641125 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.641271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.641415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.641565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.641710 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.642006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.642185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.642429 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.642579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.642722 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.642906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.643073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.643256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.643405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.643549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.643701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.643846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:22.643998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.644144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.644287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.644429 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.644581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.644744 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.644904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.645055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.645208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.645362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.645516 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.645674 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.645818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.645962 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.646139 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.646289 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.646516 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.646676 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.646841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.647123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.647289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.647443 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.647592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.647749 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.647908 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.648062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.648213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.648356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.648499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.648642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.648798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.648959 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.649106 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.649257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.649408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.649559 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.649712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.649864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.650015 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.650166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.650318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.650995 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.651704 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.651864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.652167 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.652319 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.652562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.652729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.652874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.653017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.653159 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.653310 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.653463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.653616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.653767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.653918 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.654073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.654224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.654376 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.654531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.654683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.654828 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.655004 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.655158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.655303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.655457 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.655602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.655753 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.655905 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.656058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.656211 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.656355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.656499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.656651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.656803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.656957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.657115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.657268 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.657412 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.657574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.657807 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.657965 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.658137 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.658282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.658433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.658587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.658730 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.658730 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.659060 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.659216 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.660089 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.660247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.660403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.660567 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.661205 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.661361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.661522 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.661522 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.661810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.661810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.662267 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.662438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.662592 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.662749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.662974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.663245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.663406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.663570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.663726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.663872 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.664024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.664177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.664321 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.664473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.664625 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.664776 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.664921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665382 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665688 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.665993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.666697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.666852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.667024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.667169 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.667315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.667469 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.667638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.667796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.667948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.668094 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.668244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.668388 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.668542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.668696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.668840 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.668991 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.669136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.669299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.669452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.669603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.669747 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.669897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.670049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.670210 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.670356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.670500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.670644 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.671308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.671308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.671623 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.671788 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.671939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.672092 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.672253 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.672552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.672715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.672862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.673014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.673167 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.673421 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.673593 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.673746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.673746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.674074 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.674225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.674377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.674536 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.674681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.674824 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.675003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.675003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.675297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.675454 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.675598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.675777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.675930 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.676085 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.676236 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.676396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.676540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.676540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.676820 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.676971 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.677198 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.677345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.677498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.677651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.677803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.677966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.678119 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.678271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.678415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.678646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.678796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.679006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.679171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.679317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.679460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.679611 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.679765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.680176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.680345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.680498 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.680641 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.680793 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.681426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.681590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.681737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.681737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.682009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.682185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.682337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.682511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.682826 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.683019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.683165 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.683318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.683573 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.683735 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.683889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.684034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.684189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.684334 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.684477 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.684631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.684785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.684937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.685102 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.685256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.685414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.685559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.685703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.685848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.685992 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.686143 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.686301 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.686453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.686606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.686758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.686968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.687182 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.687352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.687498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.687659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.687813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.687966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.688110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.688267 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.688421 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.688565 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.688716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.688867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.689013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.689175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.689321 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.689471 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.689623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.689776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.690001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.690167 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.690315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.690458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.690601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.690743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.690919 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.691490 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.691734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.691892 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.692047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.692205 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.692359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.692512 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.692676 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.692969 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.693114 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.693259 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.693417 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.693589 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.693843 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.694001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.694152 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.694318 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.694470 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.694619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.694778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.694949 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.695105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.695269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.695431 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.695582 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.695738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.695738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.696043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.696206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.696359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.696516 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.696665 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.696814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.696963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.697121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.697279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.697430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.697596 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.697750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.698446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.698606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.698764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.698934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.699090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.699240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.699402 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.699562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.699721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.699879 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.700029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.700186 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.700364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.700517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.700674 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.700844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.702051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.702231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.702397 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.702550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.702712 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.703073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.703242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.703403 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.703564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.703737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.703897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.704076 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.704317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.704487 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.704648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.704799 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.704956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.705107 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.705264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.705438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.705599 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.705792 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.705963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.706114 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.706264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.706428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.706586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.706746 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.706943 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.707101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.707290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.707464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.707617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.707775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.707927 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.708117 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.708327 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.708482 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.708632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.708781 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.708940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.709097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.709097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.709405 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.709564 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.709715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.709864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.710027 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.710223 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.710382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.710542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.710703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.710862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.711107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.711290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.711808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.712107 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.712275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.712429 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.712589 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.712753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.712753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.713222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.713443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.714118 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.714283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.714543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.714701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.714956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.715134 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.715426 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.715631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.715782 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.715945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.716110 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.716263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.716423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.716574 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.716732 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.716883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.716883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.717185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.717347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.717505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.717657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.717807 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.717976 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.718137 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.718290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.718442 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.718592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.718751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.718935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.719103 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.719255 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.719255 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.719559 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.719719 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.719909 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.720401 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.720569 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.720740 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.720987 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.720987 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.721360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.721851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.722214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.722387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.722543 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.722703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.722854 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.723042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.723367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.723534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.723688 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.723840 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.723990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.724141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.724305 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.724458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.724718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.724877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.725037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.725195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.725368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.725528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.725680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.725830 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.725987 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.726152 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.726251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.726333 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.726499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.726499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.726796 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.727042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.727208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.727371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.727531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.727683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.727842 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.727842 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.728153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.728303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.728455 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.728613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.728770 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.728936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.729121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.729121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.729121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.729564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.729724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.729724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.730011 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.730170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.730322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.730479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.730639 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.730791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.730971 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.731137 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.731306 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.731466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.731959 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.732126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.732409 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.732568 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.732729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.732882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.733047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.733199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.733546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.733713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.733865 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.734042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.734203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.734355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.734513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.734665 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.734964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.735142 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.735304 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.735456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.735615 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.735766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.735925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.736089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.736255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.736415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.736566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.736716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.736875 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.737750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.737940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.738112 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.738273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.738434 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.738596 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.738749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.738937 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.739107 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.739261 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.739420 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.739582 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.739743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.739895 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.740053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.740213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.740367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.740527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.740680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.740839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.741000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.741159 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.741310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.741310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.741609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.741609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.742241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.742461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.742461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.742864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.743086 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.743249 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.743401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.743734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.743903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.744064 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.744216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.744375 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.744536 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.744714 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.744881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.745146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.745305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.745457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.745610 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.745769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.745940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.745940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.746240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.746398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.746550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.746716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.746869 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.747044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.747308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.747479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.747641 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.747809 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.747974 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.748147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.748299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.748450 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.748601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.748762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.748914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.749074 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.749240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.749393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.749544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.749709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.749870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.750039 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.750192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.750349 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.750517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.750678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.750840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.751044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.751197 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.751359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.751525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.751685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.751845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.752340 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.752563 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.752747 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.752995 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.753169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.753329 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.753481 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.753648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.753939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.754110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.754271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.754423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.754582 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.754741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.754929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.755194 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.755452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.755613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.755774 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.755925 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.756088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.756240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.756399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.756551 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.756710 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.756901 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.757066 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.757231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.757382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.757533 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.757683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.757834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.758001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.758157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.758316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.758316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.758705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.758877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.759080 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.759246 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.759406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.759406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.759406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.759852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.760004 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.760164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.760844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.761010 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.761163 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.761334 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.761495 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.761648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.761811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.761963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.762129 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.762643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.762814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.763006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.763243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.763401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.763553 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.763553 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.764004 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.764183 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.764337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.764502 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.764663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.764823 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.764984 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.765136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.765295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.765448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.765609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.765609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.766005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.766157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.766320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.766473 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.766660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.766815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.767000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.767291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.767467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.767467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.767773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.767773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.768070 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.768222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.768381 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.768557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.768727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.768880 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.769038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.769190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.769348 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.769508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.769660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.769812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.769963 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.770114 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.770264 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.770423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.770575 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.770735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.770912 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.771071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.771234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.771436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.771594 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.771754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.771914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.772073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.772234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.772405 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.772920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.773091 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.773275 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.773527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.773692 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.773846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.774162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.774366 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.774538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.774692 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.774852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.775053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.775241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.775408 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.775584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.775737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.775957 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.777309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.777549 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.777709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.777862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.778013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.778181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.778341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.778500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.778667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.778821 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.778997 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.779170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.779332 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.779492 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.779653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.779813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.779974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.780207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.780363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.780514 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.780664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.780828 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.780979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.781139 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.781292 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.781450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.781613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.781765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.781925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.782088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.782248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.782402 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.782572 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.783116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.784573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.785725 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.785886 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.786052 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.786205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.786205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.786498 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.786649 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.786982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.787158 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.787312 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.787474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.787721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.787891 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.788044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.788204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.788365 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.788535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.788690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.788841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.788999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.789165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.789318 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.789705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.789705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.790042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.790042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.790042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.790582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.790737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.791067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.791222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.791387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.791572 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.791754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.791908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.792067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.792238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.792400 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.792560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.792712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.793221 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.793383 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.793543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.793727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.793985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.794143 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.794295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.794632 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.794799 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.795039 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.795195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.795346 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.795497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.795648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.795818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.795980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.796133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.796292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.796444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.796595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.796756 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.796945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.797190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.797190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.797482 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.797642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.797892 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.798061 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.798222 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.798375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.798544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.798707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.798860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799021 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799142 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799417 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799587 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799770 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.799951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800119 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800635 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.800994 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801086 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801254 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801528 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801796 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801880 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.801972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802068 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802161 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802336 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802517 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802600 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802682 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802682 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802842 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.802973 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803346 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803639 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803801 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.803948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804026 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804102 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804173 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804323 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804391 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804468 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804615 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804698 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804770 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.804838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805253 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805336 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805481 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805688 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805688 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805884 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.805884 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806155 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806454 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806608 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806822 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.806941 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.807018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.807102 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.807696 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.807771 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.807848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.807920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.807989 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808217 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808504 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808712 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.808940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809091 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809162 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809923 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.809999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810079 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810457 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810604 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810675 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810744 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.810984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811141 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811686 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.811947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812128 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812381 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812639 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.812810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813155 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813597 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813832 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.813942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814265 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.814950 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815078 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815078 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815424 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815649 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815768 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815880 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.815998 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816443 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.816946 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817064 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817181 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817604 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.817834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818515 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.818846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819004 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819119 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819351 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819584 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.819930 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820046 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820163 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820392 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820509 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820842 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.820944 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821162 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821508 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821614 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821700 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821885 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.821971 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822049 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822128 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.822791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823516 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823886 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.823956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.824342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.824465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.824597 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.824709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.824818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.824950 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.825053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.825271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.825377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.825612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.825750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.825933 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.826054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.826632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.826755 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.826843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.826962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.827062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.827148 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.827230 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.827397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.827543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.827723 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.827866 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.828039 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.828224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.828371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.828551 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.828700 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.829016 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.829107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.829342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.829434 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.829658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.829764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.829996 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.830089 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.830342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.830433 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.830684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.830785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.831048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.831144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.831363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.831459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.831673 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.831781 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.831983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.832075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.832297 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.832389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.832616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.832716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.832927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.833024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.833237 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.833329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.833546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.833639 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.833858 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.833958 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.834166 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.834257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.834473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.834564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.834782 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.834874 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.835114 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.835220 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.835428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.835519 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.835735 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.835875 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.836044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.836179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.836354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.836449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.836664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.836755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.836972 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.837073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.837281 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.837380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.837593 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.837684 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.837900 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.838002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.838207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.838305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.838535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.838637 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.838842 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.838978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.839229 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.839336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.839512 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.839603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.839857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.839959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.840181 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.840273 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.840497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.840588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.840817 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.840937 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.841145 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.841243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.841459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.841560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.841785 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.841881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.842110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.842212 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.842428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.842533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.842743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.842843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.843104 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.843199 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.843418 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.843517 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.843729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.843821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.844045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.844135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.844358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.844459 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.844670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.844769 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.844983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.845073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.845316 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.845416 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.845644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.845742 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.845954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.846049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.846268 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.846387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.846591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.846682 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.846924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.847030 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.847238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.847331 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.847547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.847638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.847861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.847965 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.848171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.848271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.848481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.848571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.848788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.848887 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.849098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.849196 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.849410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.849511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.849721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.849820 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.850028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.850126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.850335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.850433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.850649 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.850748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.850987 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.851117 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.851297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.851386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.851613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.851706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.851921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.852020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.852229 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.852322 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.852537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.852638 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.852845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.852936 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.853154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.853254 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.853492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.853588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.853833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.853932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.854172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.854273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.854490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.854581 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.854800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.854921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.855084 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:58:22.855187 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.855457 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.855787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.856117 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.856438 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.856828 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.857174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.857493 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.857809 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.858126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.858441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.858756 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.859096 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.859433 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.859770 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.860084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.860414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.860738 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.861065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.861385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.861701 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.862037 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.862350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.862663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.863009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.863329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.863643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.863964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.864277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.864591 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.864909 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.865230 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.865563 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.865894 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.866210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.866542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.866874 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.867248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.867569 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.867918 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.868252 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.868575 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.868892 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.869202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:22.869450 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:58:22.918206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Registered counter for database nova_api Oct 10 11:58:22.931133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Registered counter for database nova_api Oct 10 11:58:22.939136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:22.945604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:22.952086 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:22.958505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:23.003035 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.context [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6386297d-cd21-4182-a19e-d3837d7beef8(cell1) {{(pid=120662) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 11:58:23.007138 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:23.007628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:23.009221 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:23.009951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:23.011069 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:23.013099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:23.013554 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.context [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6386297d-cd21-4182-a19e-d3837d7beef8(cell1) {{(pid=120663) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 11:58:23.015234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Registered counter for database nova_cell0 Oct 10 11:58:23.017605 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:23.018067 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:23.019334 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Registered counter for database nova_cell1 Oct 10 11:58:23.019691 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:23.020411 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:23.020855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:23.023009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:23.025031 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Registered counter for database nova_cell0 Oct 10 11:58:23.026678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:23.029370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Registered counter for database nova_cell1 Oct 10 11:58:23.029917 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:23.033538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:23.037479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:23.039588 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:23.039998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:23.046358 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:23.047984 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:23.187623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Registered counter for database nova_cell0 Oct 10 11:58:23.194355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:23.195099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Registered counter for database nova_cell0 Oct 10 11:58:23.198861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:23.201723 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:23.206006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:23.523344 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:23.527732 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:23.531188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:23.535510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:23.888614 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:23.892129 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:23.895354 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-3a08fcea-cb64-48b7-b0c0-b60b15598c0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:23.898778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-b1f46a82-c666-4ae1-b893-4f3314a20418 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:23.900716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a2488c9c0 pid: 120663 (default app) Oct 10 11:58:23.904711 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a2488c9c0 pid: 120662 (default app) Oct 10 11:58:59.265386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:59.266323 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:59.267188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:59.268244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:00.470868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1be9c0d8-dce7-463d-8e66-8084350751c0 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Action: 'create', calling method: .version_select at 0x7f862165c4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1123567265", "metadata": {"Type": "work"}}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:02.579659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1be9c0d8-dce7-463d-8e66-8084350751c0 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.324565 Oct 10 11:59:02.580607 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Oct 10 11:58:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3327 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 10 11:59:02.602497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:02.604944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:02.607004 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:02.608085 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:02.988412 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-309597f0-9f3a-4cf2-ae66-9c5860ee7c09 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Calling method '.version_select at 0x7f86216a51f0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:03.669464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-309597f0-9f3a-4cf2-ae66-9c5860ee7c09 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b" status: 200 len: 353 microversion: 2.1 time: 1.073528 Oct 10 11:59:03.679753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 11:59:02 2022] GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b => generated 353 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:04.688530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-19d58223-8ab2-4a9b-9de0-3fd2ea3cf406 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Calling method '.version_select at 0x7f86215303a0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:04.797160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-19d58223-8ab2-4a9b-9de0-3fd2ea3cf406 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b" status: 200 len: 354 microversion: 2.1 time: 0.113515 Oct 10 11:59:04.805765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 11:59:04 2022] GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:04.811713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2421b5bb-0941-4019-83ae-53ac692edd28 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Calling method '.version_select at 0x7f862156f3a0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:04.920411 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2421b5bb-0941-4019-83ae-53ac692edd28 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b" status: 200 len: 354 microversion: 2.1 time: 0.112941 Oct 10 11:59:04.934463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 11:59:04 2022] GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:04.940467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c285d12c-b669-4a4a-922a-feaddb82dd15 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Calling method '.version_select at 0x7f8621530a60>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:05.121521 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c285d12c-b669-4a4a-922a-feaddb82dd15 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b" status: 202 len: 0 microversion: 2.1 time: 0.185508 Oct 10 11:59:05.122556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 11:59:04 2022] DELETE /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:59:05.131523 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-28c4a1aa-f06e-421c-82de-1541049ad076 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Calling method '.version_select at 0x7f862156fa60>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:05.307938 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-28c4a1aa-f06e-421c-82de-1541049ad076 tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b" status: 200 len: 353 microversion: 2.1 time: 0.181072 Oct 10 11:59:05.308466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 11:59:05 2022] GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:06.321764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3903f3b-b2cf-49de-82bc-a40cfe192bef tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Calling method '.version_select at 0x7f86214cd160>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:06.375576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-d3903f3b-b2cf-49de-82bc-a40cfe192bef tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] HTTP exception thrown: Volume b00071ba-31ac-433b-a00b-59dc8c737e9b could not be found. Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3903f3b-b2cf-49de-82bc-a40cfe192bef tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Request method failure captured: Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b HTTP/1.1 Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkD4gKbGp_EccAFrwO0QIMzRfcEz7HPgEV4fKPqxHGx6HKiR-dRz0nlaYKiIMlXwCA4lls21S3caE4PlSDxRTEMD-8WDFjZZ1VFpG_z6vE9Hyyv4XAqpmmma1Z_E4ho520F0tXKEtHAYw5JrawnyZYxAHiiNTTAmOv5ucwgA1iXXzE Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 41c3718a446542109d01276a99950b84 Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesGetTestJSON-595153455 Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 11:59:06.380065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/41c3718a446542109d01276a99950b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_41c3718a446542109d01276a99950b84", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/41c3718a446542109d01276a99950b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/41c3718a446542109d01276a99950b84"}]}] Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesGetTestJSON-595153455 Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 41c3718a446542109d01276a99950b84 Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesGetTestJSON-595153455 Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesGetTestJSON-595153455-project Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: f633c812bb6446a49107a05b3c956366 Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesGetTestJSON-595153455-project Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Volume b00071ba-31ac-433b-a00b-59dc8c737e9b could not be found. Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'b00071ba-31ac-433b-a00b-59dc8c737e9b'} Oct 10 11:59:06.381765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b00071ba-31ac-433b-a00b-59dc8c737e9b could not be found. (HTTP 404) (Request-ID: req-3c49e20e-8471-4565-ae96-b13fe855685b) Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:59:06.382576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 11:59:06.383533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b00071ba-31ac-433b-a00b-59dc8c737e9b could not be found. Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 11:59:06.384502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b00071ba-31ac-433b-a00b-59dc8c737e9b could not be found. Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b00071ba-31ac-433b-a00b-59dc8c737e9b could not be found. Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3903f3b-b2cf-49de-82bc-a40cfe192bef tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] Returning 404 to user: Volume b00071ba-31ac-433b-a00b-59dc8c737e9b could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3903f3b-b2cf-49de-82bc-a40cfe192bef tempest-VolumesGetTestJSON-595153455 tempest-VolumesGetTestJSON-595153455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b" status: 404 len: 109 microversion: 2.1 time: 0.063572 Oct 10 11:59:06.387124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 11:59:06 2022] GET /compute/v2.1/os-volumes/b00071ba-31ac-433b-a00b-59dc8c737e9b => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:59:07.014640 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd34a9af-118e-46f7-8a6b-926178e5f097 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'create', calling method: .version_select at 0x7f862156fb80>, body: {"keypair": {"name": "tempest-keypair-1108491535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnw3XtIEwEgJdOZnH8dCxWGrNWTp1WGISsBQZYM/TJDgPJQlDw79js9oO/sPN4/AWlGSiySCR9a3hwIwsTvxBE/mAfU/eSMggz7VoJZJ7b//fBQpZDuqfixTyTSo/Xf7w=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:07.087038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bd34a9af-118e-46f7-8a6b-926178e5f097 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for project 0156957151444f94be28a65b4b018156. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:07.097098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bd34a9af-118e-46f7-8a6b-926178e5f097 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for user b051e414038b470691ee3e91b952a87d and project 0156957151444f94be28a65b4b018156. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:07.166430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd34a9af-118e-46f7-8a6b-926178e5f097 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.650237 Oct 10 11:59:07.175071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 4/8] 10.222.0.52 () {62 vars in 1200 bytes} [Mon Oct 10 11:59:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 660 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 11:59:13.310036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-871116026", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7586f293-9e29-43b7-8515-0f510030ca27"}], "security_groups": [{"name": "tempest-securitygroup--1727569687"}], "key_name": "tempest-keypair-1108491535", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:14.189986 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] validate_networks() for [('7586f293-9e29-43b7-8515-0f510030ca27', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:59:14.842767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e2b1830e-bfd7-4c52-9e46-313c5f3e5495 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: .version_select at 0x7f86214ad160>, body: {"keypair": {"name": "tempest-keypair-575014218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO50H5YZixe/Vdl0OaOD4KKJ+yCDCxi+00YIcfkQEGXkM9UbPLq6aTUvOvOwJr08bc5VNHuDV0p0bFKVS/qF4F55+jexit5XuddLTbHUJjaLTmDG6/Urx421DLyAyUo4/g=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:14.859610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-e2b1830e-bfd7-4c52-9e46-313c5f3e5495 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:14.865559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-e2b1830e-bfd7-4c52-9e46-313c5f3e5495 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:14.897670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e2b1830e-bfd7-4c52-9e46-313c5f3e5495 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.312462 Oct 10 11:59:14.906167 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 5/9] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 11:59:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:17.143470 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:59:17.143956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:59:17.144355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:59:17.145358 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:59:17.146094 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:59:17.201632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:17.218610 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:17.221960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:17.223315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:17.224122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:17.224851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:17.288530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for project 0156957151444f94be28a65b4b018156. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:17.302245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for user b051e414038b470691ee3e91b952a87d and project 0156957151444f94be28a65b4b018156. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:17.320568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:59:17.323947 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:59:17.432734 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b9703fff-b1e5-4074-a88f-5690fa9077f1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.128979 Oct 10 11:59:17.434945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 5/10] 10.222.0.52 () {62 vars in 1188 bytes} [Mon Oct 10 11:59:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 4132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 11:59:17.447212 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a438a04b-c8c8-42aa-96d4-688631406c6f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:17.448045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a438a04b-c8c8-42aa-96d4-688631406c6f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:17.713927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a438a04b-c8c8-42aa-96d4-688631406c6f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:17.766146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a438a04b-c8c8-42aa-96d4-688631406c6f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:17.780482 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a438a04b-c8c8-42aa-96d4-688631406c6f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:17.785203 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a438a04b-c8c8-42aa-96d4-688631406c6f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1281 microversion: 2.20 time: 0.343620 Oct 10 11:59:17.794298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 6/11] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:17 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1281 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:18.825690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d07e0acf-1ba0-481f-a9e4-6c81ff1b0994 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:18.827443 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d07e0acf-1ba0-481f-a9e4-6c81ff1b0994 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:19.012315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d07e0acf-1ba0-481f-a9e4-6c81ff1b0994 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:19.031016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d07e0acf-1ba0-481f-a9e4-6c81ff1b0994 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:19.041848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d07e0acf-1ba0-481f-a9e4-6c81ff1b0994 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:19.044357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d07e0acf-1ba0-481f-a9e4-6c81ff1b0994 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1281 microversion: 2.20 time: 0.225321 Oct 10 11:59:19.044943 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 6/12] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:18 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:20.072483 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:20.073170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:20.084350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:20.084856 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:20.085300 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:20.086022 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:20.086511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:20.087484 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:20.765457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:20.787902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:20.789842 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:20.791305 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-96c9279b-d6b7-4345-9d81-fc4e9869f971 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1285 microversion: 2.20 time: 0.723216 Oct 10 11:59:20.792083 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 7/13] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:20 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1285 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:21.259985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-914819912", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05a9786c-a8d0-4fea-bd0d-744e4b7d958a"}], "security_groups": [{"name": "tempest-securitygroup--338154536"}], "key_name": "tempest-keypair-575014218", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:21.477575 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f23ce63-bc97-4d8a-923f-8ed529ec6469 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'create', calling method: .version_select at 0x7f8620b6db80>, body: {"keypair": {"name": "tempest-keypair-1200324675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLZ46jF+O9SLpQb7BfYSrJXFDunZOBf8uD6mJTeFrMqjU/Klv/kCTpCjus3bQtl7XEd/oi7DgMprDT8BBYXozQYUb7hyCR57kgQi4Lkf+6M4mE7GfVQjKvKLCvOL1qnzg=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:21.549465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-6f23ce63-bc97-4d8a-923f-8ed529ec6469 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for project 79aee39298624f99b33b9808fe5030f8. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:21.559966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-6f23ce63-bc97-4d8a-923f-8ed529ec6469 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for user 0c0f1d116c004694b33b19d988ac4959 and project 79aee39298624f99b33b9808fe5030f8. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:21.620186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f23ce63-bc97-4d8a-923f-8ed529ec6469 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.472322 Oct 10 11:59:21.621180 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 7/14] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 11:59:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:21.719914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] validate_networks() for [('05a9786c-a8d0-4fea-bd0d-744e4b7d958a', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:59:21.818590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:21.819513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:21.846722 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:21.848124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:21.850349 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:21.853980 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:21.854697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:21.862223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:22.202976 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:22.265133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:22.276641 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:22.289075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c22d73d-a7e3-479e-8002-d6583ef368eb tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1341 microversion: 2.20 time: 0.473605 Oct 10 11:59:22.292069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 8/15] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:21 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1341 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:59:23.319065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:23.320571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:23.331065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:23.335977 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:23.336711 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:23.337888 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:23.338678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:23.339344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:23.915439 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:23.934150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:23.941017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:23.944284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9692f7af-a97e-4469-88e7-2e1a3dd82737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1339 microversion: 2.20 time: 0.629948 Oct 10 11:59:23.948005 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 9/16] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:23 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1339 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:24.009113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:59:24.010332 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:59:24.011150 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:59:24.012146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:59:24.012778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:59:24.033008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:24.037441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:24.038176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:24.040044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:24.042792 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:24.044544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:24.182048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:24.196787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:24.260990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:59:24.278549 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:59:24.467540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c616af90-4c04-4e86-a6f2-8d23a1c0ed34 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.221376 Oct 10 11:59:24.468580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 8/17] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 11:59:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 3223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:59:24.496732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4c2e03b1-6e3d-43c6-9088-9dd5d2e10227 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:24.497665 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4c2e03b1-6e3d-43c6-9088-9dd5d2e10227 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:24.986101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4c2e03b1-6e3d-43c6-9088-9dd5d2e10227 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:25.000342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1711865047", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "networks": [{"uuid": "34b06faa-9ac1-44a9-be49-fe3ff8492ca5"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:25.007976 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4c2e03b1-6e3d-43c6-9088-9dd5d2e10227 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1240 microversion: 2.1 time: 0.530997 Oct 10 11:59:25.013740 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 9/18] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:24 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1240 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:25.043892 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:25.044844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:25.071387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:25.071891 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:25.072334 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:25.073058 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:25.073516 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:25.073944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:25.255645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] validate_networks() for [('34b06faa-9ac1-44a9-be49-fe3ff8492ca5', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:59:27.179717 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:27.191850 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:27.197652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:27.203545 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-18036cf4-373c-4f7d-afd9-7076583adf8a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 2.184898 Oct 10 11:59:27.204757 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 10/19] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:25 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:27.270733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:27.845430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-100973530", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:27.981298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] validate_networks() for [('2ac8f1d1-c12a-4843-a8c4-2e6d690ca422', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:59:28.953920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:59:28.954409 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:59:28.954813 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:59:28.955247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:59:28.955985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:59:28.991371 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:28.993613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:28.996228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:28.997897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:28.998382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:29.019348 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:29.111456 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Getting quotas for project d57fdf43bdef4f0dabd51175a84e9093. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:29.127581 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Getting quotas for user 8568f2501f824875bae7ab1825cc2c32 and project d57fdf43bdef4f0dabd51175a84e9093. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:29.174156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:59:29.178958 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:59:29.422851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-70f0f9e8-c696-43f2-a960-4c4ce550a34e tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.471759 Oct 10 11:59:29.431273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 11:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:59:29.471264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:29.473785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:29.532295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:29.536915 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:29.540821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:29.550570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:29.555128 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:29.558851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:30.030809 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:30.045380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4a930178-5adb-4ca8-9ee5-6e3ed1c761e5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1298 microversion: 2.1 time: 0.601313 Oct 10 11:59:30.048102 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 11/21] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:29 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1298 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:30.066976 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:30.072739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:30.095427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:30.099322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:30.099322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:30.099322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:30.101645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:30.102739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:31.095266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:31.108099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:31.127356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:31.128871 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-68177fa7-e916-4339-8b68-32942f99e4f8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 1.078986 Oct 10 11:59:31.148612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 12/22] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:30 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:31.169449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:31.170179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:31.176546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:31.180923 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:31.181571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:31.182469 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:31.186526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:31.187208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:31.870419 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:31.898741 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-838d0a80-1e77-4908-98bb-0e19a1fec278 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1219 microversion: 2.1 time: 0.748292 Oct 10 11:59:31.903921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 13/23] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:31 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1219 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:32.347301 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-3dd08688-2a92-45b3-be96-4f548c8daf7a req-b40eb239-f623-483b-a34b-5ea88fe0e6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37bc3237-f592-4db7-9f6a-294f4cea3c9a", "tag": "fa2ac855-9b1f-4330-96cc-cad641c595d3"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:32.414574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3dd08688-2a92-45b3-be96-4f548c8daf7a req-b40eb239-f623-483b-a34b-5ea88fe0e6e1 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:32.423423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3dd08688-2a92-45b3-be96-4f548c8daf7a req-b40eb239-f623-483b-a34b-5ea88fe0e6e1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:32.423878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3dd08688-2a92-45b3-be96-4f548c8daf7a req-b40eb239-f623-483b-a34b-5ea88fe0e6e1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:32.528601 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-3dd08688-2a92-45b3-be96-4f548c8daf7a req-b40eb239-f623-483b-a34b-5ea88fe0e6e1 service nova] Creating event network-changed:fa2ac855-9b1f-4330-96cc-cad641c595d3 for instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a on hv-cinder-85061 Oct 10 11:59:32.529806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3dd08688-2a92-45b3-be96-4f548c8daf7a req-b40eb239-f623-483b-a34b-5ea88fe0e6e1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 11:59:32.529806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3dd08688-2a92-45b3-be96-4f548c8daf7a req-b40eb239-f623-483b-a34b-5ea88fe0e6e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 11:59:32.530719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:32.531207 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:32.535676 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:32.544132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:32.557053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:32.557748 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:32.606126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.compute.rpcapi [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 11:59:32.607945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] Releasing lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 11:59:32.680193 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d2db27a-0c6e-4fbf-bc1f-d998f798b55c None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.771802 Oct 10 11:59:32.686002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 14/24] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:32.719878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:32.723415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:32.751606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:32.779690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:32.779690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:32.783942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:32.787898 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:32.792558 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:33.338798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:59:33.341048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:59:33.344281 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:59:33.344933 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:59:33.345578 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:59:33.354783 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=5 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:33.371481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=19 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:33.389461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:33.401337 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:33.404393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:33.405534 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:33.407431 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:33.410690 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:33.488607 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:33.495641 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for user 99b3e727e6fa480c90a054a60b68b8d0 and project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:33.524818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:59:33.535026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:59:33.636158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:33.645758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ee67564b-74d5-4ffb-a225-3b2a3143ff69 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.945209 Oct 10 11:59:33.646281 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 15/25] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:32 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:33.665306 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:33.665945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:33.689345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2644040d-c8d0-4f4e-9c43-f3a3f7b93976 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.481704 Oct 10 11:59:33.691935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 11/26] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 11:59:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 6486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:59:33.699369 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:33.699938 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:33.704584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:33.707191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:33.719348 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:33.722233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:33.722650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:33.723132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:33.735364 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:33.737535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:33.738194 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:33.741559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:33.743526 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:33.744856 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:33.946193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:33.956559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-eb5b69ac-2abf-429e-8488-799f609deabd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1273 microversion: 2.1 time: 0.262657 Oct 10 11:59:33.960309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 12/27] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:33 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:33.980234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-277488591", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c924414-a382-471c-a40e-c6f3cc3eb62c"}], "security_groups": [{"name": "tempest-securitygroup--2092331344"}], "key_name": "tempest-keypair-1200324675", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:34.837494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] validate_networks() for [('5c924414-a382-471c-a40e-c6f3cc3eb62c', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:59:35.288249 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:35.314569 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:35.322069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:35.330021 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2a13cadc-f7df-4809-97bb-d8d25ab825e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 1.669801 Oct 10 11:59:35.334024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 16/28] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:33 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:35.359315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:35.361678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:35.394733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:35.397193 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:35.400645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:35.406102 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:35.423183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:35.423791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:35.646443 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:35.655377 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a8774c3b-dc24-40ac-a4e8-4c232286ea1d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1217 microversion: 2.1 time: 0.319432 Oct 10 11:59:35.659652 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 17/29] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:35 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1217 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:35.664568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:35.669696 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:35.688703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:35.695720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:35.696945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:35.702195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:35.702958 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:35.703610 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:36.642659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:36.657543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d8cd8d0f-4376-42fa-a8bb-175b09b484cf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.996318 Oct 10 11:59:36.658141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 18/30] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:35 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:36.694533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:36.697773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:36.731775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:36.737863 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:36.739180 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:36.741418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:36.745425 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:36.747050 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:37.098319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:59:37.098821 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:59:37.099300 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:59:37.099916 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:59:37.100342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:59:37.118439 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:37.118962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:37.132105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:37.132937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:37.139303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:37.143250 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:37.247444 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for project 79aee39298624f99b33b9808fe5030f8. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:37.273714 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for user 0c0f1d116c004694b33b19d988ac4959 and project 79aee39298624f99b33b9808fe5030f8. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:37.331638 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:59:37.334213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:59:37.478974 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ccfe3076-eba0-411e-821f-1ba6e78d9f4f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.507448 Oct 10 11:59:37.480371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 13/31] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 11:59:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:59:37.486855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-870476006", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:37.633465 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] validate_networks() for [('2ac8f1d1-c12a-4843-a8c4-2e6d690ca422', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:59:38.518358 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:38.536138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1f62ab40-d787-4bf4-940a-68243b4c8e83 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 1.859158 Oct 10 11:59:38.539208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 19/32] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:36 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:38.550859 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-1c7d3056-4ef4-4fb4-a126-f413d4f81090 req-d37d1b29-8778-4c00-a763-467c13991301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddfe581-92c6-4065-9fff-7ebe3462658b", "tag": "b0a4554c-8489-4c92-b988-ba8723479120"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:38.579750 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1c7d3056-4ef4-4fb4-a126-f413d4f81090 req-d37d1b29-8778-4c00-a763-467c13991301 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:38.580894 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1c7d3056-4ef4-4fb4-a126-f413d4f81090 req-d37d1b29-8778-4c00-a763-467c13991301 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:38.581794 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1c7d3056-4ef4-4fb4-a126-f413d4f81090 req-d37d1b29-8778-4c00-a763-467c13991301 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:38.621083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-1c7d3056-4ef4-4fb4-a126-f413d4f81090 req-d37d1b29-8778-4c00-a763-467c13991301 service nova] Creating event network-changed:b0a4554c-8489-4c92-b988-ba8723479120 for instance 0ddfe581-92c6-4065-9fff-7ebe3462658b on hv-cinder-85061 Oct 10 11:59:38.635969 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-1c7d3056-4ef4-4fb4-a126-f413d4f81090 req-d37d1b29-8778-4c00-a763-467c13991301 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095138 Oct 10 11:59:38.641013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 20/33] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:38.652699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:38.655748 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:38.676346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:38.679751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:38.680914 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:38.683876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:38.699979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:38.700791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.148956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=18 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:39.553232 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:59:39.553732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:59:39.554359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:59:39.554776 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:59:39.555252 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:59:39.559877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:39.584062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.584685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.584789 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:39.584975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.587348 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:39.588216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d61011d0-8c64-4edf-a23c-104635c5161a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.945800 Oct 10 11:59:39.588732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.592789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.593707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.597968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 21/34] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:38 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:39.617638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:39.622399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:39.644716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.645223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.645660 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.646371 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.646827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.647291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.662453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:59:39.679988 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for user 99b3e727e6fa480c90a054a60b68b8d0 and project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:59:39.714299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:59:39.718359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:59:39.839500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:39.852305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fa2e6ff3-5ac6-40dc-ad46-861eae1a77f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.250911 Oct 10 11:59:39.857372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 22/35] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:39 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:39.865579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:39.866833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:39.878776 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bf7f9419-3e02-41c1-a488-2659ef2d1238 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.397036 Oct 10 11:59:39.884930 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.887083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.887776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.889998 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.890791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.892168 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.897378 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 14/36] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 11:59:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:59:39.918289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:39.935912 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:39.964033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.964480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.981876 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:39.998289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:39.999477 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:39.999935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:40.337323 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:40.350959 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c04e5175-1ed5-4227-9e2e-131cdd82267a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.492249 Oct 10 11:59:40.351575 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 23/37] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:39 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:40.383815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f38ea36-28fd-49ce-a44d-76815094420d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:40.384480 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6f38ea36-28fd-49ce-a44d-76815094420d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:40.535680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f38ea36-28fd-49ce-a44d-76815094420d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:40.548870 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f38ea36-28fd-49ce-a44d-76815094420d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1221 microversion: 2.1 time: 0.174514 Oct 10 11:59:40.549808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 24/38] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:40 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:40.633027 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:40.634609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:40.653713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:40.654216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:40.654968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:40.655691 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:40.656260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:40.657029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:40.687374 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:40.700827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7fe95a48-0fe9-48a3-9d53-bb833f28b26b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.796996 Oct 10 11:59:40.702057 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 15/39] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:39 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:40.837962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-d7e696b0-1815-46c6-8b3d-0a61bfcbde35 req-c7b63b16-6392-4275-a3e9-9ae5777fd679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5206ecbd-33e4-45ba-849b-408b6c33be7c", "tag": "6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:40.855569 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d7e696b0-1815-46c6-8b3d-0a61bfcbde35 req-c7b63b16-6392-4275-a3e9-9ae5777fd679 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:40.856373 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d7e696b0-1815-46c6-8b3d-0a61bfcbde35 req-c7b63b16-6392-4275-a3e9-9ae5777fd679 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:40.857100 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d7e696b0-1815-46c6-8b3d-0a61bfcbde35 req-c7b63b16-6392-4275-a3e9-9ae5777fd679 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:40.885972 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-d7e696b0-1815-46c6-8b3d-0a61bfcbde35 req-c7b63b16-6392-4275-a3e9-9ae5777fd679 service nova] Creating event network-changed:6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1 for instance 5206ecbd-33e4-45ba-849b-408b6c33be7c on hv-cinder-85061 Oct 10 11:59:40.887023 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d7e696b0-1815-46c6-8b3d-0a61bfcbde35 req-c7b63b16-6392-4275-a3e9-9ae5777fd679 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 11:59:40.888056 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d7e696b0-1815-46c6-8b3d-0a61bfcbde35 req-c7b63b16-6392-4275-a3e9-9ae5777fd679 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 11:59:40.890704 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:40.891424 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:40.892125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:40.893211 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:40.893866 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:40.895126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:40.909654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.compute.rpcapi [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 11:59:40.910928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 11:59:40.943053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-20c21eda-5132-4eba-8650-29c6b977a3f6 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106395 Oct 10 11:59:40.944582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 16/40] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:59:40.957794 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:40.959109 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:40.974980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:40.976095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:40.976573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:40.977366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:40.979508 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:40.980173 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:41.081291 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:41.098693 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-af111482-ad04-4256-bf94-68f19e361a2f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.149880 Oct 10 11:59:41.115066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 17/41] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:40 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:41.115318 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:41.124697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:41.127223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:41.128387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-89ce1b6d-c578-473b-a210-e6a4883bda92 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.501196 Oct 10 11:59:41.128956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 25/42] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:40 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:41.377371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:41.378707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:41.385681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:41.386149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:41.386765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:41.387642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:41.388108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:41.388536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:41.541269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:41.550681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8bf8bd0-2bbe-4c88-969e-1fffc5884ab8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.177426 Oct 10 11:59:41.552799 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 18/43] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:41 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:41.573099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:41.573706 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:41.579910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:41.580619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:41.581218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:41.582073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:41.582672 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:41.583269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:41.651294 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:41.655390 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:41.660309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-21e074ed-216c-4c3b-91c5-cc195533386f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1225 microversion: 2.1 time: 0.091042 Oct 10 11:59:41.661243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 26/44] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:41 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:41.729097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:41.729743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:41.745190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:41.746366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:41.746748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:41.747956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:41.748367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:41.748802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:41.959767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:41.970937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a97e340e-2ff3-4d68-bbd7-c9f60ee58908 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.249319 Oct 10 11:59:41.971844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 19/45] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:41 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:42.121016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:42.121711 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:42.128351 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.128827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.129557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.130381 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.131024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.131455 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.154054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:42.155057 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:42.161811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.162658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.163290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.164160 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.164836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.165542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.225176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:42.234710 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c5d14f0b-18ae-462a-b5d9-0de5ad0dac18 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.117716 Oct 10 11:59:42.235339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 27/46] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:42 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:42.341136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:42.349153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:42.350709 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:42.351874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c8a82774-6d12-4caa-9c99-e426368bc576 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.201802 Oct 10 11:59:42.353012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 20/47] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:42 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:59:42.575222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:42.575993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:42.581980 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.582471 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.582925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.583629 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.584087 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.584510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.599963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:42.688532 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:42.688878 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:42.695009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.695517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.696571 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.697303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:42.697758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:42.698184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:42.770610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:42.778981 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b8d0d25-5475-4ff8-82c8-bd25fa547bdc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1225 microversion: 2.1 time: 0.094847 Oct 10 11:59:42.779269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:42.779910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 21/48] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:42 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:42.793127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-140b03af-939f-4b3c-92f7-17d1d5061e48 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.221705 Oct 10 11:59:42.793945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 28/49] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:42 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:42.993425 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:42.994126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:43.000207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.000682 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.001110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.001791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.002240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.002659 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.135693 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:43.143841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-12524d6a-39e3-4950-86b9-2c1e1ac4fd12 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.154207 Oct 10 11:59:43.144360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 22/50] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:42 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:43.257593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:43.258773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:43.264731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.265219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.265663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.266357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.267032 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.267273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.330315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:43.337996 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2b86f78d-56a5-4890-b180-0e17b9097591 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.084300 Oct 10 11:59:43.338570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 29/51] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:43 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:43.376453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:43.377150 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:43.383113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.384572 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.385137 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.385894 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.386418 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.387011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.520401 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:43.528420 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:43.529897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:43.531046 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e18b2310-90fa-4fc6-b84b-cb47d3fe68ba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.158409 Oct 10 11:59:43.531613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 23/52] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:43 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:43.803575 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:43.804825 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:43.811815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:43.813856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.815381 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.816068 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.817039 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.817698 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.818311 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.819593 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:43.821097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:43.829747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.830971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.832325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.834983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:43.835637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:43.837104 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:43.911276 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:43.920346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e1480909-6dd3-4565-8287-73cd1acfe565 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1225 microversion: 2.1 time: 0.121969 Oct 10 11:59:43.920979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 30/53] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:43 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:43.999095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:44.006957 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dfa76d8f-6c8e-4a42-bd77-384cb4749cc2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.191830 Oct 10 11:59:44.007540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 24/54] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:43 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:44.168317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:44.169030 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:44.174976 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.175454 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.175890 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.176580 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.177031 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.177456 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.319920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:44.332096 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-262c830c-e39b-4800-8d94-d53121406ebd tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.169434 Oct 10 11:59:44.341123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 31/55] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:44 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:44.360221 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:44.360835 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:44.368479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.369999 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.370546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.371286 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.371739 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.372332 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.440948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:44.449655 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7e04e445-fc26-47e1-b1e9-1c7da4ed5d4c tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.093100 Oct 10 11:59:44.450365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 25/56] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:44 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:44.558233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:44.559047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:44.565248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.565729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.566164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.566845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.567331 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.567750 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.723157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:44.731699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:44.733116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:44.734210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cfb0e476-2090-493b-b844-5ee793366316 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.181996 Oct 10 11:59:44.734771 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 32/57] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:44 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:44.944479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:44.945085 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:44.951665 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.952136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.952565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.953240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:44.953688 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:44.954107 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:44.958005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=91 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:45.015485 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:45.022836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fa2e4c60-0fd9-4dc1-9260-1e2de45de99d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1225 microversion: 2.1 time: 0.082200 Oct 10 11:59:45.023434 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 26/58] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:44 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:45.029889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:45.030501 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:45.036357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.036835 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.037266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.037946 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.038396 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.038961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.163625 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:45.172203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-418e47ec-9708-4058-8e71-5cdaed75c85f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.146057 Oct 10 11:59:45.172767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 33/59] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:45 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:45.353473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:45.354115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:45.360037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.360511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.360942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.361619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.362072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.362496 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.471545 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:45.472150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:45.477969 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.478446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.478873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.479570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.480020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.480440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.487604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:45.495607 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-19665229-a3cb-4efa-ac7d-4a8bd9a206d8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.145993 Oct 10 11:59:45.499663 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 27/60] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:45 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:45.544427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:45.551948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-200c72ad-1a4a-448e-8834-cc99aa994266 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.084305 Oct 10 11:59:45.552504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 34/61] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:45 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:45.758583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:45.759204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:45.765100 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.765584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.766020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.766707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:45.767189 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:45.767622 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:45.892572 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:45.900801 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:45.902318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:45.903452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-761c47e1-5fc3-4c0e-a2f8-856ce2e7c263 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.148758 Oct 10 11:59:45.904008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 28/62] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:45 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:46.045747 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:46.046272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:46.052176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.052654 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.053083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.053759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.054472 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.054908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.113120 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:46.120454 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e41995d-883a-4e9a-80b1-fa50f6f9c8fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1225 microversion: 2.1 time: 0.078625 Oct 10 11:59:46.121014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 35/63] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:46 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:46.194939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:46.195556 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:46.201374 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.201847 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.202275 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.202977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.203426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.203845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.330990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:46.339273 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4230e177-4c74-4bae-b2b5-f96449b040af tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.148033 Oct 10 11:59:46.339838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 29/64] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:46 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:46.518357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:46.519040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:46.525497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.525966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.526390 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.527090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.527542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.527958 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.575225 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:46.575846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:46.582081 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.582690 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.583157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.583847 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.584464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.584888 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.667622 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:46.675106 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5a28bcd5-893a-4391-b277-32dbbc64f2c8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.104625 Oct 10 11:59:46.676209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 30/65] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:46 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:46.679355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:46.687157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5ffd50fe-67f1-43be-8658-add87f0645f9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.172601 Oct 10 11:59:46.687709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 36/66] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:46 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:46.929536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:46.930315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:46.938155 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.938814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.940195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:46.941008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:46.941567 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:46.942949 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:47.081692 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:47.089706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:47.091206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:47.092299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-afe0addb-1809-4bdf-a74f-a6a46f464e38 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.167470 Oct 10 11:59:47.092860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 31/67] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:46 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:47.142823 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:47.143393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:47.149233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:47.149707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:47.150153 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:47.151139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:47.151691 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:47.152107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:47.216725 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:47.225677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1c6451a9-5aeb-4cce-a7dd-1b370973d94d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1225 microversion: 2.1 time: 0.086625 Oct 10 11:59:47.226597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 37/68] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:47 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:47.363747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:47.365187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:47.372666 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:47.374323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:47.375000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:47.376640 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:47.377428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:47.378061 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:47.698224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:47.698834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:47.710378 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:47.716129 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:47.717072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:47.718186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:47.722578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:47.724269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:48.039448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:48.048196 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dacc5861-1995-4195-a39e-22316e6b9adf tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1289 microversion: 2.1 time: 0.354252 Oct 10 11:59:48.058413 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:48.061845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 38/69] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:47 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1289 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:48.066416 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1bc6796c-2c8a-44c3-930d-6953c15d069f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.707259 Oct 10 11:59:48.070604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 32/70] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:47 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:48.072827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:48.073446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:48.087059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:48.087556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:48.088557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:48.089270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:48.089728 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:48.090154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:48.117334 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:48.117973 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:48.145493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:48.146030 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:48.146460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:48.147215 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:48.147682 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:48.148108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:48.636855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:48.646019 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8ff07c72-c0f1-4a9c-9ef5-db8cffa427c5 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.577735 Oct 10 11:59:48.655182 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:48.660140 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 39/71] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:48 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:48.666075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:48.666690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:48.667245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:48.669149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:48.670497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dfe44918-edc7-4f07-adc8-d4b38651be14 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.557082 Oct 10 11:59:48.671193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 33/72] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:48 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:48.682730 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:48.683257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:48.683690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:48.684388 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:48.684838 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:48.685457 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:48.844057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:48.865713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2352b4b8-c46c-40e7-a4e9-827208979016 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1281 microversion: 2.1 time: 0.204355 Oct 10 11:59:48.868764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 40/73] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:48 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:49.074196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:49.075249 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:49.088708 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.089479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.090242 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.091175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:49.091492 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.091945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:49.092043 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.092367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.101905 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.102624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.104059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.105616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.106479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.107170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.315205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:49.326498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a80aac76-9f38-418c-a8e6-f32191343f3d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1295 microversion: 2.1 time: 0.256445 Oct 10 11:59:49.328156 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 34/74] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:49 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1295 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:49.507520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:49.521409 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b572f36a-8d2b-4c4a-a012-75a0c698f856 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.434091 Oct 10 11:59:49.523278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 41/75] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:49 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:49.686535 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:49.688136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:49.705465 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=17 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:49.745228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.748058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.752779 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.755106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.772474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.772932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.897205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-248df491-62a7-4cd6-82b1-6c50ac38d12d req-3d44ae1b-d362-43be-9fc2-af6ca5d2e627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc3237-f592-4db7-9f6a-294f4cea3c9a", "name": "network-vif-plugged", "status": "completed", "tag": "fa2ac855-9b1f-4330-96cc-cad641c595d3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:49.911071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-248df491-62a7-4cd6-82b1-6c50ac38d12d req-3d44ae1b-d362-43be-9fc2-af6ca5d2e627 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.912392 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-248df491-62a7-4cd6-82b1-6c50ac38d12d req-3d44ae1b-d362-43be-9fc2-af6ca5d2e627 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.913737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-248df491-62a7-4cd6-82b1-6c50ac38d12d req-3d44ae1b-d362-43be-9fc2-af6ca5d2e627 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.930304 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-248df491-62a7-4cd6-82b1-6c50ac38d12d req-3d44ae1b-d362-43be-9fc2-af6ca5d2e627 service nova] Creating event network-vif-plugged:fa2ac855-9b1f-4330-96cc-cad641c595d3 for instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a on hv-cinder-85061 Oct 10 11:59:49.937671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-248df491-62a7-4cd6-82b1-6c50ac38d12d req-3d44ae1b-d362-43be-9fc2-af6ca5d2e627 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354576 Oct 10 11:59:49.942042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 35/76] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:49.959240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:49.960110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:49.968130 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.969047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.969739 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:49.971381 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:49.972003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:49.972576 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:50.546178 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:50.625418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:50.670570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-52aa8fe1-b68e-4543-b658-d3994f7077fa tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.987604 Oct 10 11:59:50.674223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 42/77] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:49 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:50.686186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:50.687299 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:50.698777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:50.699561 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:50.699730 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:50.700555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:50.701010 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:50.701428 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:50.757740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:50.910012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=10 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:50.927854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:50.940017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a160efd6-69a4-4ef9-8163-d2404203aace tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1279 microversion: 2.1 time: 0.263452 Oct 10 11:59:50.955018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 43/78] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:50 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:51.093456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:51.110588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:51.113892 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:51.117870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-416c45c4-0548-4890-a6f3-d3ed757dd9e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 1.164654 Oct 10 11:59:51.140461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 36/79] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:49 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:51.150951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:51.151656 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:51.158383 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.159121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.159678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.160589 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.161259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.161934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.185116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-61135bdf-d82c-4b05-a8c2-01f8705cbb81 req-18ffec8f-8efe-4eca-888d-a5303331156c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0079dd21-134c-4eba-b98a-5e223f5bfb49", "tag": "b6770e59-ceb9-442a-901d-70ac68923881"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:51.205705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-61135bdf-d82c-4b05-a8c2-01f8705cbb81 req-18ffec8f-8efe-4eca-888d-a5303331156c service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.208173 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-61135bdf-d82c-4b05-a8c2-01f8705cbb81 req-18ffec8f-8efe-4eca-888d-a5303331156c service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.211531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-61135bdf-d82c-4b05-a8c2-01f8705cbb81 req-18ffec8f-8efe-4eca-888d-a5303331156c service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.250436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-61135bdf-d82c-4b05-a8c2-01f8705cbb81 req-18ffec8f-8efe-4eca-888d-a5303331156c service nova] Creating event network-changed:b6770e59-ceb9-442a-901d-70ac68923881 for instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 on hv-cinder-85061 Oct 10 11:59:51.261558 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-61135bdf-d82c-4b05-a8c2-01f8705cbb81 req-18ffec8f-8efe-4eca-888d-a5303331156c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.302888 Oct 10 11:59:51.261793 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 44/80] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:51.269729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:51.270141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:51.280057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.280735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.281347 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.282391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.282861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.283327 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.574481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:51.584292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-611a87ff-8962-41df-99c9-8fc34de21187 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.442260 Oct 10 11:59:51.599893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 37/81] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:51 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:51.600016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:51.610942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-544ebe35-b7b3-41b2-8010-c33ef88edef8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.346029 Oct 10 11:59:51.623506 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 45/82] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:51 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:51.697721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:51.698351 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:51.705573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.706131 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.706569 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.707464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.708251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.708826 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.945371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:51.959638 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-860b0705-fa32-4685-b830-3746ece1d841 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.266707 Oct 10 11:59:51.960337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-a6b7faf0-2b55-4ea7-9816-f3f94a9c1000 req-e5d64b17-3be0-4d0f-b0f7-bcfb9f0c617b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddfe581-92c6-4065-9fff-7ebe3462658b", "name": "network-vif-plugged", "status": "completed", "tag": "b0a4554c-8489-4c92-b988-ba8723479120"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:51.961164 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 38/83] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:51 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:51.972175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:51.972789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:51.979509 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a6b7faf0-2b55-4ea7-9816-f3f94a9c1000 req-e5d64b17-3be0-4d0f-b0f7-bcfb9f0c617b service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.980002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a6b7faf0-2b55-4ea7-9816-f3f94a9c1000 req-e5d64b17-3be0-4d0f-b0f7-bcfb9f0c617b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.980436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a6b7faf0-2b55-4ea7-9816-f3f94a9c1000 req-e5d64b17-3be0-4d0f-b0f7-bcfb9f0c617b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.990839 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.991359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.991792 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:51.992498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:51.995732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:51.997324 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:52.001058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-a6b7faf0-2b55-4ea7-9816-f3f94a9c1000 req-e5d64b17-3be0-4d0f-b0f7-bcfb9f0c617b service nova] Creating event network-vif-plugged:b0a4554c-8489-4c92-b988-ba8723479120 for instance 0ddfe581-92c6-4065-9fff-7ebe3462658b on hv-cinder-85061 Oct 10 11:59:52.013767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-a6b7faf0-2b55-4ea7-9816-f3f94a9c1000 req-e5d64b17-3be0-4d0f-b0f7-bcfb9f0c617b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057330 Oct 10 11:59:52.014461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 46/84] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:59:52.148377 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:52.149085 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:52.150174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:52.158015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:52.158791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e5a12fe5-c6b7-4dc4-882e-5b394044bfca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.190504 Oct 10 11:59:52.159167 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:52.160005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 39/85] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:51 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:52.162248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:52.163096 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:52.163867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:52.165867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:52.426220 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:52.437938 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:52.439433 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:52.446941 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c6b84f78-fc70-4b47-b6d7-83de2bd0b21a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1407 microversion: 2.20 time: 0.303108 Oct 10 11:59:52.452079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 47/86] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:52 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:59:52.615874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:52.616778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:52.621732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:52.626939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:52.627696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:52.628393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:52.629389 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:52.630054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:52.630700 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:52.635299 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:52.636273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:52.642625 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:52.643146 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:52.643854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:52.644571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:52.645027 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:52.645453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:53.396760 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:53.406711 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-639b53e0-5bce-4e5a-9bf1-d6f2a2e6722b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.796731 Oct 10 11:59:53.407405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 40/87] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:52 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:53.422345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:53.437798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-911b199c-6f96-4b0d-acfa-c9b3fe08d3b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.807330 Oct 10 11:59:53.438560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 48/88] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:52 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:53.475768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:53.475768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:53.483397 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:53.488008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:53.491838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:53.492330 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:53.492762 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:53.497448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:53.498463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:53.499403 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:53.504986 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:53.505854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:53.507534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:53.511098 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:53.512097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:53.512845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.103429 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:54.116586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-090b7509-fdc1-47da-b8ae-6e60509a7444 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.659854 Oct 10 11:59:54.117701 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 49/89] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:53 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:54.130471 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:54.131403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:54.138703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.139370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.139871 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.140744 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.141295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.141800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.144534 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:54.153862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c895a614-8b49-4036-8fc2-a4d4e24768c8 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.744349 Oct 10 11:59:54.156348 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 41/90] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:53 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:54.430345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:54.431285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:54.437166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:54.441841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.443554 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.444227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.445395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.445637 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:54.446838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.447187 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:54.447846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.448785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ad0af096-1045-461a-baae-db1771c3be6a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1599 microversion: 2.20 time: 0.329705 Oct 10 11:59:54.449530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 50/91] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 11:59:54 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1599 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:59:54.472633 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:54.473879 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:54.481956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.482599 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.483191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.483968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.484520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.485103 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.817714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:54.821131 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:54.827202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d17e7894-ddee-4d86-93fc-e3fc2d6ee1dc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.370204 Oct 10 11:59:54.828762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 51/92] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:54 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:54.830885 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-94b262a8-9db6-446a-96d0-d0b614ea5068 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.404757 Oct 10 11:59:54.842722 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 42/93] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:54 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:54.847194 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-b710c33f-334e-4b4f-92e1-334ff41f86b9 req-a920aecb-917b-4022-863c-791a5c796e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ca0d44-4c8c-44a3-b638-4983f27a9aba", "tag": "32e17a37-9b9d-4960-877e-e2b3e5fc255f"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:54.847357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:54.847787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:54.853715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.854202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.854694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.855426 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.856287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.856287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.857696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b710c33f-334e-4b4f-92e1-334ff41f86b9 req-a920aecb-917b-4022-863c-791a5c796e3a service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:54.858380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b710c33f-334e-4b4f-92e1-334ff41f86b9 req-a920aecb-917b-4022-863c-791a5c796e3a service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:54.859279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b710c33f-334e-4b4f-92e1-334ff41f86b9 req-a920aecb-917b-4022-863c-791a5c796e3a service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:54.872083 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-b710c33f-334e-4b4f-92e1-334ff41f86b9 req-a920aecb-917b-4022-863c-791a5c796e3a service nova] Creating event network-changed:32e17a37-9b9d-4960-877e-e2b3e5fc255f for instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba on hv-cinder-85061 Oct 10 11:59:54.877893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-b710c33f-334e-4b4f-92e1-334ff41f86b9 req-a920aecb-917b-4022-863c-791a5c796e3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044157 Oct 10 11:59:54.878583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 43/94] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:54.978225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-52f4fe5a-d1fe-499c-be21-a04459a8e3a1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.148011 Oct 10 11:59:54.978816 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 52/95] 10.222.0.52 () {60 vars in 1316 bytes} [Mon Oct 10 11:59:54 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:59:55.141311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:55.142008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:55.148039 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.148518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.148953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:55.149646 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.150098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.150518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:55.154503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:55.185127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:55.185777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:55.191648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.192135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.192570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:55.193273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.193699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.194119 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:55.479786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:55.487439 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-506ab83f-b24d-4f61-afc0-f32942066e07 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.350346 Oct 10 11:59:55.488008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 44/96] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:55 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:55.491159 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:55.499189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd1a46bb-0e31-47e0-b627-0202658b3308 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.318360 Oct 10 11:59:55.499892 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 53/97] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:55 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:55.852282 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:55.853040 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:55.853444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:55.854076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:55.859372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.859940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.860224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.860530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:55.860704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.861133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:55.861413 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.861814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:55.861935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.862269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:55.862538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:55.862683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:56.208500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:56.215777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:56.216529 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ef13205c-38d4-4b81-a1ab-f4143246a40b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.368095 Oct 10 11:59:56.217182 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 45/98] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:55 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:56.239053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ac11921-c84d-4f22-8b8c-9bb4392a63a1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.389335 Oct 10 11:59:56.239639 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 54/99] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:55 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:56.509601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:56.510125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:56.515923 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:56.516400 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:56.517028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:56.517723 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:56.518188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:56.518595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:56.521935 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:56.522800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:56.529473 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:56.530195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:56.530833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:56.531754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:56.532389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:56.534303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:56.736681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:56.743448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:56.748458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-512daacd-62af-413a-b132-335744cca358 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.242694 Oct 10 11:59:56.749165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 46/100] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:56 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:56.751465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-48a0b018-7d25-4f65-b790-c9bbc4761d71 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.233539 Oct 10 11:59:56.752027 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 55/101] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:56 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:56.897049 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-1f1936c6-0357-4975-bf63-9ec8751335f2 req-5fe073ec-9cdd-46ef-a402-0305b6d26d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2361c0-e286-45a7-a0d6-0a62221cdd27", "tag": "6800ab16-3bab-4f54-bff2-7a9c18dfc7b7"}, {"name": "network-changed", "server_uuid": "37bc3237-f592-4db7-9f6a-294f4cea3c9a", "tag": "fa2ac855-9b1f-4330-96cc-cad641c595d3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:56.907932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1f1936c6-0357-4975-bf63-9ec8751335f2 req-5fe073ec-9cdd-46ef-a402-0305b6d26d10 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:56.908443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1f1936c6-0357-4975-bf63-9ec8751335f2 req-5fe073ec-9cdd-46ef-a402-0305b6d26d10 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:56.908876 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1f1936c6-0357-4975-bf63-9ec8751335f2 req-5fe073ec-9cdd-46ef-a402-0305b6d26d10 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:56.920969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-1f1936c6-0357-4975-bf63-9ec8751335f2 req-5fe073ec-9cdd-46ef-a402-0305b6d26d10 service nova] Creating event network-changed:6800ab16-3bab-4f54-bff2-7a9c18dfc7b7 for instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 on hv-cinder-85061 Oct 10 11:59:56.921477 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-1f1936c6-0357-4975-bf63-9ec8751335f2 req-5fe073ec-9cdd-46ef-a402-0305b6d26d10 service nova] Creating event network-changed:fa2ac855-9b1f-4330-96cc-cad641c595d3 for instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a on hv-cinder-85061 Oct 10 11:59:56.927756 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-1f1936c6-0357-4975-bf63-9ec8751335f2 req-5fe073ec-9cdd-46ef-a402-0305b6d26d10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034338 Oct 10 11:59:56.928356 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 47/102] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:57.240394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:57.241643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:57.248851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.249476 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.250149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.250954 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.251694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.252214 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.262530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:57.263266 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:57.273637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.274170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.274815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.275521 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.275981 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.276406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.479897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:57.496880 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-57ebaa05-cd3b-4e1b-a74b-859d6470e349 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1365 microversion: 2.1 time: 0.260339 Oct 10 11:59:57.497800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 56/103] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:57 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:57.564929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:57.585644 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-f3b99096-ef0c-402e-8507-6eb469180ea1 req-433241e3-fb5a-45f9-80c1-588540cbae93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5206ecbd-33e4-45ba-849b-408b6c33be7c", "name": "network-vif-plugged", "status": "completed", "tag": "6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:57.588931 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-957128a0-c2a2-45f6-be46-48030de2821e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.329747 Oct 10 11:59:57.590017 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 48/104] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:57 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:57.599329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f3b99096-ef0c-402e-8507-6eb469180ea1 req-433241e3-fb5a-45f9-80c1-588540cbae93 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.599829 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f3b99096-ef0c-402e-8507-6eb469180ea1 req-433241e3-fb5a-45f9-80c1-588540cbae93 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.600325 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f3b99096-ef0c-402e-8507-6eb469180ea1 req-433241e3-fb5a-45f9-80c1-588540cbae93 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.614392 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-f3b99096-ef0c-402e-8507-6eb469180ea1 req-433241e3-fb5a-45f9-80c1-588540cbae93 service nova] Creating event network-vif-plugged:6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1 for instance 5206ecbd-33e4-45ba-849b-408b6c33be7c on hv-cinder-85061 Oct 10 11:59:57.623536 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-f3b99096-ef0c-402e-8507-6eb469180ea1 req-433241e3-fb5a-45f9-80c1-588540cbae93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047634 Oct 10 11:59:57.624383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 57/105] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:59:57.771841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:57.772712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:57.776787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:57.777767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:57.779622 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.780105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.780848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.782020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.783235 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.783830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.786487 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.787324 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.787968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.789028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:57.789753 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:57.790367 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:57.984327 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:58.001317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:58.010083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7ea6ca10-abc5-4247-911a-975e99d77360 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.239446 Oct 10 11:59:58.010926 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 58/106] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:57 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:58.011084 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f1eadc06-49b7-4c97-8140-344e87d3b0c7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.231007 Oct 10 11:59:58.011626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 49/107] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:57 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:58.526568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:58.527349 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:58.545528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:58.546457 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:58.547090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:58.548033 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:58.548631 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:58.549336 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:58.619071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:58.619689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:58.631528 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:58.632322 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:58.633256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:58.634103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:58.635260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:58.635900 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:58.903415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:58.906670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:58.911271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7c153861-c6fe-47b3-ab6e-7d35c01a73e6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.301553 Oct 10 11:59:58.911845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 50/108] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:58 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:58.914720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8165277a-581d-4f2b-8984-0064ad34dcd1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1554 microversion: 2.1 time: 0.392915 Oct 10 11:59:58.915399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 59/109] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:58 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1554 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:58.938046 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:58.938790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:58.944660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:58.945132 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:58.945558 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:58.946234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:58.946686 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:58.947767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:59.034494 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:59.035024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:59.041737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:59.042217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:59.042649 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:59.043365 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:59.043815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:59.044240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:59.415280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-940acd2d-9f48-4475-aca1-3ba07f9a993b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.480972 Oct 10 11:59:59.416628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 51/110] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 11:59:58 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-interface => generated 284 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:59.422115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:59.423879 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:59.432394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:59.433157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:59.433683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:59.434284 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:59.434742 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:59.435321 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:59.749830 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:59.759451 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d95fb859-5d34-4c24-8f76-8bb1d4213d1c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1315 microversion: 2.1 time: 0.730443 Oct 10 11:59:59.770360 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 60/111] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:59 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:59:59.780621 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-820e1d2e-09c0-4293-8670-314a69f42b7b req-e6130fa9-a829-49ab-9f74-60fa68c82e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0079dd21-134c-4eba-b98a-5e223f5bfb49", "name": "network-vif-plugged", "status": "completed", "tag": "b6770e59-ceb9-442a-901d-70ac68923881"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:59:59.811577 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-820e1d2e-09c0-4293-8670-314a69f42b7b req-e6130fa9-a829-49ab-9f74-60fa68c82e07 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:59.812171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-820e1d2e-09c0-4293-8670-314a69f42b7b req-e6130fa9-a829-49ab-9f74-60fa68c82e07 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:59.812668 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-820e1d2e-09c0-4293-8670-314a69f42b7b req-e6130fa9-a829-49ab-9f74-60fa68c82e07 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:59.825281 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:59:59.834466 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-820e1d2e-09c0-4293-8670-314a69f42b7b req-e6130fa9-a829-49ab-9f74-60fa68c82e07 service nova] Creating event network-vif-plugged:b6770e59-ceb9-442a-901d-70ac68923881 for instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 on hv-cinder-85061 Oct 10 11:59:59.834737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a9f4e8d7-b3d2-412d-b5d4-18cbf2721bd0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.416581 Oct 10 11:59:59.835085 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 52/112] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:59 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:59:59.861703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-820e1d2e-09c0-4293-8670-314a69f42b7b req-e6130fa9-a829-49ab-9f74-60fa68c82e07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089277 Oct 10 11:59:59.863495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 61/113] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 11:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:59:59.940567 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:59:59.944564 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:59:59.959960 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:59.961179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:59.961859 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:59:59.963626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:59:59.964249 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:59:59.964861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:00.213962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:00.223825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6dbb09fe-4b5a-4a61-b645-9936020d4ad7 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.292055 Oct 10 12:00:00.224773 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 53/114] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 11:59:59 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:00.784437 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:00.786087 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:00.795751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:00.796567 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:00.797449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:00.798419 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:00.799351 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:00.799988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:00.866224 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:00.871394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:00.877439 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:00.877929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:00.878556 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:00.879285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:00.879737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:00.880158 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:01.208617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:01.225972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7e9da61e-9715-4d8d-a932-5450b808ca69 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1499 microversion: 2.1 time: 0.447778 Oct 10 12:00:01.228560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 62/115] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:00 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1499 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:01.228712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:01.249305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:01.249929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:01.255605 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-40bc3a2e-6c03-44b6-8306-55bc0c73d742 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.393252 Oct 10 12:00:01.259070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:01.259598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:01.260038 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:01.260744 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:01.261197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:01.262296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 54/116] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:00 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:01.262940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:01.267693 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:01.477678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:01.491287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11a034a6-3bf1-4818-96ac-4f3ed2d558c1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.247771 Oct 10 12:00:01.494500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 63/117] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:01 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:01.633737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-6eb44fd8-61ab-4598-8aed-2f1a5fefb3bd req-afdc16a8-dc82-49a0-90a5-1ee60714ec68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddfe581-92c6-4065-9fff-7ebe3462658b", "tag": "b0a4554c-8489-4c92-b988-ba8723479120"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:01.659222 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6eb44fd8-61ab-4598-8aed-2f1a5fefb3bd req-afdc16a8-dc82-49a0-90a5-1ee60714ec68 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:01.659717 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6eb44fd8-61ab-4598-8aed-2f1a5fefb3bd req-afdc16a8-dc82-49a0-90a5-1ee60714ec68 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:01.660219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6eb44fd8-61ab-4598-8aed-2f1a5fefb3bd req-afdc16a8-dc82-49a0-90a5-1ee60714ec68 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:01.674126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-6eb44fd8-61ab-4598-8aed-2f1a5fefb3bd req-afdc16a8-dc82-49a0-90a5-1ee60714ec68 service nova] Creating event network-changed:b0a4554c-8489-4c92-b988-ba8723479120 for instance 0ddfe581-92c6-4065-9fff-7ebe3462658b on hv-cinder-85061 Oct 10 12:00:01.705136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-6eb44fd8-61ab-4598-8aed-2f1a5fefb3bd req-afdc16a8-dc82-49a0-90a5-1ee60714ec68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075916 Oct 10 12:00:01.705763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 55/118] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:02.296654 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:02.297452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:02.311156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:02.313542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:02.314008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:02.314695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:02.318717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:02.319678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:02.526062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:02.530231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:02.544738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:02.545357 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:02.545896 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:02.546708 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:02.547442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:02.547953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:02.554865 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:02.563584 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0c0cae32-fb57-45bd-b077-54c9db7d37a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.281273 Oct 10 12:00:02.564677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 64/119] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:02 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:02.827318 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45ae9634-1c31-48a3-8b54-12ae9b16e691"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:02.836842 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:02.843964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:02.844814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:02.845472 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:02.846378 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:02.847055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:02.847669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:02.870436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:02.881953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6611e07b-28ce-4373-9047-e4943a7280b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.368534 Oct 10 12:00:02.883204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 56/120] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:02 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:03.591062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:03.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:03.599613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:03.600102 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:03.600731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:03.601441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:03.602219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:03.602652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:03.813522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:03.824237 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-21834997-94ef-433b-8764-e09b899ee207 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.239429 Oct 10 12:00:03.834975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 57/121] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:03 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:03.907945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:03.908636 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:03.914791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:03.915558 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:03.916059 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:03.916822 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:03.917338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:03.917998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:04.054193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:04.063409 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-20c82612-4bd6-4b9a-969b-1ee8d99b08ff tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.159850 Oct 10 12:00:04.064429 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 58/122] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:03 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:04.853515 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:04.854195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:04.860520 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:04.861003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:04.861438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:04.862131 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:04.863142 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:04.863577 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:05.328364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-12c30a2b-56b1-44c9-883d-96319ed5d703 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "POST /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.498931 Oct 10 12:00:05.336884 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 65/123] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:00:02 2022] POST /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c/os-volume_attachments => generated 194 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:05.342397 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:05.342987 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:05.366152 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:05.367302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:05.367941 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:05.369560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:05.370348 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:05.370963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:05.490542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:05.503834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-52a8b51f-210b-487e-9f84-5cf2736f248c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.655351 Oct 10 12:00:05.515411 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 59/124] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:04 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:05.651990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:05.662916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ec6c0d29-ccf9-48b2-9d47-3915443ca07b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.322417 Oct 10 12:00:05.663638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 66/125] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:05 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:06.547448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:06.548050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:06.557377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:06.558161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:06.559174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:06.561002 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:06.562643 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:06.564601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:06.687746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:06.688356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:06.694669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:06.695177 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:06.695606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:06.696320 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:06.696771 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:06.697191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:06.708328 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:06.716218 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b3f268fa-a2bd-4a18-987c-c67931a23849 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.172582 Oct 10 12:00:06.716795 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 60/126] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:06 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:06.823846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:06.831314 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bee5e627-ba7d-462b-a3ea-0f0515e52f68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.147314 Oct 10 12:00:06.831886 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 67/127] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:06 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:07.552742 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-fc9a241e-aef1-42df-91af-4c547196cab3 req-ab3f1999-40af-4924-bca4-bd5affee167e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2361c0-e286-45a7-a0d6-0a62221cdd27", "name": "network-vif-plugged", "status": "completed", "tag": "6800ab16-3bab-4f54-bff2-7a9c18dfc7b7"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:07.562373 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fc9a241e-aef1-42df-91af-4c547196cab3 req-ab3f1999-40af-4924-bca4-bd5affee167e service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:07.562781 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fc9a241e-aef1-42df-91af-4c547196cab3 req-ab3f1999-40af-4924-bca4-bd5affee167e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:07.563541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fc9a241e-aef1-42df-91af-4c547196cab3 req-ab3f1999-40af-4924-bca4-bd5affee167e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:07.575611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-fc9a241e-aef1-42df-91af-4c547196cab3 req-ab3f1999-40af-4924-bca4-bd5affee167e service nova] Creating event network-vif-plugged:6800ab16-3bab-4f54-bff2-7a9c18dfc7b7 for instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 on hv-cinder-85061 Oct 10 12:00:07.580473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-fc9a241e-aef1-42df-91af-4c547196cab3 req-ab3f1999-40af-4924-bca4-bd5affee167e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031399 Oct 10 12:00:07.581071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 61/128] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:07.739595 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:07.740200 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:07.747270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:07.747786 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:07.748251 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:07.748971 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:07.749427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:07.749850 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:07.854935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:07.855790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:07.862144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:07.862615 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:07.863157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:07.863922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:07.864474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:07.865029 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:07.967877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:07.975579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a4457155-3090-47f6-b958-f1068311302d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.239863 Oct 10 12:00:07.976479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 68/129] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:07 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:08.037927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:08.046132 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-67f878d7-1351-4fe8-a039-815179bc1899 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.196118 Oct 10 12:00:08.046701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 62/130] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:07 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:09.001095 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:09.001701 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:09.008152 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:09.008632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:09.009055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:09.009742 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:09.010190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:09.010616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:09.069290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:09.069923 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:09.076829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:09.077304 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:09.077731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:09.078413 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:09.078860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:09.079304 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:09.081902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:09.225401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:09.233095 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e18af286-76a8-43d3-aa17-e0d7c8ac9c00 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.235820 Oct 10 12:00:09.233673 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 69/131] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:08 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:09.271662 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:09.279290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b8aa76a9-9e65-45f6-960d-27534d6b6d35 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.213812 Oct 10 12:00:09.279862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 63/132] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:09 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:10.258375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:10.259012 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:10.266243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:10.266781 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:10.267243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:10.267931 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:10.268384 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:10.268902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:10.302050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:10.302876 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:10.312418 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:10.312907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:10.313376 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:10.314077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:10.314535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:10.314983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:10.448113 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:10.455805 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-80ee9f0a-ff29-44f2-9355-325249a7752f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.201194 Oct 10 12:00:10.456376 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 70/133] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:10 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:10.481089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:10.488633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-478123f9-d4e2-4cda-bdcf-1a8e3458b0a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.190776 Oct 10 12:00:10.489206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 64/134] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:10 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:11.462598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-6d914cc4-c1d6-42b3-a761-0457987edf84 req-5b76cd4e-9088-4c41-9e41-2abe1787605f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ca0d44-4c8c-44a3-b638-4983f27a9aba", "name": "network-vif-plugged", "status": "completed", "tag": "32e17a37-9b9d-4960-877e-e2b3e5fc255f"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:11.478609 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:11.479109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6d914cc4-c1d6-42b3-a761-0457987edf84 req-5b76cd4e-9088-4c41-9e41-2abe1787605f service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:11.479823 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6d914cc4-c1d6-42b3-a761-0457987edf84 req-5b76cd4e-9088-4c41-9e41-2abe1787605f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:11.479990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:11.480221 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6d914cc4-c1d6-42b3-a761-0457987edf84 req-5b76cd4e-9088-4c41-9e41-2abe1787605f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:11.487157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:11.487647 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:11.488088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:11.488787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:11.489241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:11.490478 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:11.491850 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-6d914cc4-c1d6-42b3-a761-0457987edf84 req-5b76cd4e-9088-4c41-9e41-2abe1787605f service nova] Creating event network-vif-plugged:32e17a37-9b9d-4960-877e-e2b3e5fc255f for instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba on hv-cinder-85061 Oct 10 12:00:11.498026 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-6d914cc4-c1d6-42b3-a761-0457987edf84 req-5b76cd4e-9088-4c41-9e41-2abe1787605f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039713 Oct 10 12:00:11.498623 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 71/135] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:11.512619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:11.513316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:11.519553 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:11.520118 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:11.520702 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:11.521399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:11.522040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:11.522560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:11.691403 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:11.695540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:11.699011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-58edef3a-f43e-49f0-8c87-98a5f46391f9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.224473 Oct 10 12:00:11.699576 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 65/136] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:11 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:11.703127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8bf18e36-1872-44e3-a704-e1ffdd485676 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.194481 Oct 10 12:00:11.703686 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 72/137] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:11 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:12.721396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:12.722012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:12.725966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:12.727063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:12.728743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:12.729699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:12.730121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:12.730946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:12.731302 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:12.731812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:12.735262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:12.735869 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:12.736453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:12.737206 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:12.737821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:12.738318 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:12.936057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:12.939465 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:12.944224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a87b3501-eb56-4730-acd1-30a91126d5f3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1363 microversion: 2.1 time: 0.222632 Oct 10 12:00:12.945945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 73/138] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:12 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:12.949487 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e9e6ad97-70ea-4148-9bb9-2435df1649ac tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.231918 Oct 10 12:00:12.950339 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 66/139] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:12 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:13.972065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:13.972883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:13.973459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:13.974169 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:13.979929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=88 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:13.982261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:13.982646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:13.982777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:13.983156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:13.983274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:13.983595 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:13.984198 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:13.984302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:13.984740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:13.984841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:13.985144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:13.985268 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:14.181411 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:14.187999 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:14.189157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e257a34c-c2cc-42d0-8216-9a9d3aa8d240 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1548 microversion: 2.1 time: 0.221066 Oct 10 12:00:14.189727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 74/140] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:13 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1548 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:14.195922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-80f33f10-19ec-4f5a-8523-8a024fd3c90f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.226380 Oct 10 12:00:14.196476 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 67/141] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:13 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:14.212236 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:14.212787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:14.219185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:14.219669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:14.220099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:14.220800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:14.221234 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:14.221659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:14.301294 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-28ff9b36-a158-4353-ba69-59ea0496d9ea tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092710 Oct 10 12:00:14.301907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 75/142] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 12:00:14 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:00:15.219261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:15.219855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:15.226560 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:15.227027 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:15.228645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:15.229368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:15.230142 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:15.230578 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:15.275556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-bbcd56ad-47da-4b03-80d0-6a753a2f4ed6 req-6193316a-f5a7-46c6-9b28-849a0bd87f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2361c0-e286-45a7-a0d6-0a62221cdd27", "tag": "6800ab16-3bab-4f54-bff2-7a9c18dfc7b7"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:15.286788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bbcd56ad-47da-4b03-80d0-6a753a2f4ed6 req-6193316a-f5a7-46c6-9b28-849a0bd87f2f service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:15.287540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bbcd56ad-47da-4b03-80d0-6a753a2f4ed6 req-6193316a-f5a7-46c6-9b28-849a0bd87f2f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:15.287967 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bbcd56ad-47da-4b03-80d0-6a753a2f4ed6 req-6193316a-f5a7-46c6-9b28-849a0bd87f2f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:15.299791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-bbcd56ad-47da-4b03-80d0-6a753a2f4ed6 req-6193316a-f5a7-46c6-9b28-849a0bd87f2f service nova] Creating event network-changed:6800ab16-3bab-4f54-bff2-7a9c18dfc7b7 for instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 on hv-cinder-85061 Oct 10 12:00:15.306279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-bbcd56ad-47da-4b03-80d0-6a753a2f4ed6 req-6193316a-f5a7-46c6-9b28-849a0bd87f2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036747 Oct 10 12:00:15.307888 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 76/143] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:00:15.378680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:15.387102 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-864f3f08-2c63-4db7-8a92-34f9d4b5c415 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.171713 Oct 10 12:00:15.387684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 68/144] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:15 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:16.410643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:16.415795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:16.424990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:16.425467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:16.426093 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:16.426855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:16.427480 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:16.427898 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:16.571801 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:16.581673 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-03680a78-f621-44ac-bc2a-804ca3099b64 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.174951 Oct 10 12:00:16.582737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 77/145] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:16 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:17.292983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:17.293580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:17.301701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:17.302187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:17.302627 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:17.303464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:17.304188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:17.304615 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:17.331375 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:00:17.436859 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a0d7cafe-a361-411c-9435-c546d2dfb8b1 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 204 len: 0 microversion: 2.1 time: 0.147524 Oct 10 12:00:17.437611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 69/146] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:00:17 2022] DELETE /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:00:17.445635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:17.446377 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:17.453651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:17.454256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:17.454775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:17.455657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:17.456402 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:17.456906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:17.592187 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:17.606309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:17.607210 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:17.613513 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:17.614000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:17.614432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:17.615230 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:17.615955 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:17.616531 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:17.616671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-644e39b3-9279-43d3-a30c-c35431bb7b37 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.174820 Oct 10 12:00:17.617245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 78/147] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:17 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:17.867187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:17.882479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-42c1c7fe-ccff-4e85-a792-721c6b99c411 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.281349 Oct 10 12:00:17.883070 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 70/148] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:17 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:18.640146 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:18.640786 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:18.647525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:18.648154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:18.648603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:18.649297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:18.649887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:18.650321 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:18.788816 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:18.798146 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6e09198e-1254-452c-a89e-4d6efa5ffe6f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.162907 Oct 10 12:00:18.799006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 79/149] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:18 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:18.906166 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:18.906814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:18.913088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:18.913568 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:18.913998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:18.914683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:18.915166 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:18.915588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:19.046798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:19.055124 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bb40f6e4-fcb5-4e33-becb-a5f66ac4007c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1321 microversion: 2.1 time: 0.153011 Oct 10 12:00:19.055835 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 71/150] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:18 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:19.823013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:19.823861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:19.831015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:19.831573 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:19.832077 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:19.832841 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:19.833499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:19.834138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:19.839088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:19.980727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:19.990227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-20ae087e-b609-4397-9884-133684f145ae tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.171725 Oct 10 12:00:19.990823 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 80/151] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:19 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:20.079987 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:20.080606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:20.086883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:20.087578 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:20.088722 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:20.089580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:20.090256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:20.090857 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:20.567607 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:20.576757 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-275286f9-4739-48f0-950e-07312e3a4726 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1515 microversion: 2.1 time: 0.501370 Oct 10 12:00:20.577778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 72/152] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:20 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1515 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:20.600572 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:20.602843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:20.609108 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:20.609603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:20.610040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:20.610741 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:20.611280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:20.611709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:20.650595 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'flavor' on Instance uuid 42ca0d44-4c8c-44a3-b638-4983f27a9aba {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:00:20.807590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d1baad26-080e-4a4e-82e1-f157c60e81ca tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba/action" status: 200 len: 32 microversion: 2.1 time: 0.210346 Oct 10 12:00:20.808690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 81/153] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:00:20 2022] POST /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:00:20.820653 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:20.821661 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:20.829449 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:20.829939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:20.830677 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:20.831651 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:20.832788 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:20.833191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:21.011663 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:21.014127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:21.014834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:21.022325 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:21.023036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:21.023478 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:21.024172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:21.024804 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:21.025227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:21.029465 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-377fccbc-a7c9-45fa-be2c-358bcb8c791a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.212972 Oct 10 12:00:21.030563 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 73/154] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:20 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:21.157241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:21.166819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cc86a10a-d2b8-4132-90c7-9ce2aa206bee tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.157121 Oct 10 12:00:21.167486 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 82/155] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:21 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:22.053111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:22.054058 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:22.060909 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:22.061715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:22.062228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:22.063044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:22.063588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:22.064179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:22.191697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:22.193047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:22.201100 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:22.202480 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:22.203495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:22.204827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:22.205363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:22.206015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:22.209929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:22.218680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fbbbbb80-ef52-4e95-99fc-295240c49b51 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.169634 Oct 10 12:00:22.219306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 74/156] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:22 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:22.357769 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:22.367091 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c024c649-26e3-4b4b-b9cd-d1d4c3a4ac77 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.180223 Oct 10 12:00:22.367885 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 83/157] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:22 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:23.241857 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:23.242471 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:23.245074 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:23.250671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:23.251190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:23.251633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:23.252325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:23.252785 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:23.253212 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:23.378247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:23.385986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3898f97a-30e4-4448-8cfa-e3072399b2e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.147943 Oct 10 12:00:23.386554 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 75/158] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:23 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:23.389700 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:23.390315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:23.396802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:23.397279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:23.397711 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:23.398396 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:23.398851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:23.399941 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:23.531647 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:23.539823 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6e68fa94-33fb-4ed4-849c-7f12d82678e4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.153884 Oct 10 12:00:23.540387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 84/159] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:23 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:24.409058 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:24.409677 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:24.415752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:24.416843 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:24.417290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:24.417984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:24.418445 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:24.419106 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:24.545796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:24.554053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8ee36e77-4407-4de9-9f0d-51222f922fee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.148551 Oct 10 12:00:24.554671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 76/160] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:24 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:24.562807 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:24.563531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:24.570143 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:24.570710 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:24.571244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:24.572016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:24.573055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:24.573555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:24.706281 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:24.715146 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b104300f-2d4a-44f5-ad19-bde397248176 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.156111 Oct 10 12:00:24.715716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 85/161] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:24 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:25.469386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-bbff4e76-e904-4718-b54e-5b928ec3491b req-8f0436d3-dd76-49c3-b640-30a19605d20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5206ecbd-33e4-45ba-849b-408b6c33be7c", "name": "network-vif-unplugged", "status": "completed", "tag": "6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:25.479924 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bbff4e76-e904-4718-b54e-5b928ec3491b req-8f0436d3-dd76-49c3-b640-30a19605d20a service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:25.480561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bbff4e76-e904-4718-b54e-5b928ec3491b req-8f0436d3-dd76-49c3-b640-30a19605d20a service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:25.481024 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bbff4e76-e904-4718-b54e-5b928ec3491b req-8f0436d3-dd76-49c3-b640-30a19605d20a service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:25.493729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-bbff4e76-e904-4718-b54e-5b928ec3491b req-8f0436d3-dd76-49c3-b640-30a19605d20a service nova] Creating event network-vif-unplugged:6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1 for instance 5206ecbd-33e4-45ba-849b-408b6c33be7c on hv-cinder-85061 Oct 10 12:00:25.500021 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-bbff4e76-e904-4718-b54e-5b928ec3491b req-8f0436d3-dd76-49c3-b640-30a19605d20a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034618 Oct 10 12:00:25.500753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 77/162] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:25.576973 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:25.577602 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:25.583920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:25.584560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:25.584990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:25.585666 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:25.586111 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:25.586525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:25.709399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:25.717528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-38ada864-19ea-47a1-b51c-78eb49036d12 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.144396 Oct 10 12:00:25.718095 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 86/163] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:25 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:25.739175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:25.739838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:25.745777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:25.746247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:25.746675 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:25.747384 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:25.747832 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:25.748246 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:25.874208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:25.876502 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:25.884289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b06814a5-87db-4e84-8e6f-0af6041d1692 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.149444 Oct 10 12:00:25.884905 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 78/164] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:25 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:26.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:26.741077 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:26.747342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:26.747818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:26.748249 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:26.748922 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:26.749373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:26.749789 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:26.877331 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:26.885346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fde3813f-31a3-4d79-9e7f-8e001e9f7b3e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.148169 Oct 10 12:00:26.886041 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 87/165] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:26 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:26.906161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:26.906775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:26.913902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:26.914402 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:26.914819 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:26.915525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:26.915979 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:26.916402 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:27.039975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:27.048001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8cb6ccff-4402-44b6-9c11-e5cd9f747962 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.145597 Oct 10 12:00:27.048567 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 79/166] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:26 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:27.908871 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:27.909474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:27.915822 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:27.916303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:27.916734 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:27.917415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:27.917867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:27.918291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:28.071153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:28.073089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:28.079153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:28.079650 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:28.080092 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:28.080791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:28.081270 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:28.081701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:28.233132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:28.240785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e8f8f6e2-53a9-4cf3-bd60-61e4b58f69b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.335717 Oct 10 12:00:28.241358 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 88/167] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:27 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:28.253752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:28.263032 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2ffd02fd-00e1-4d43-a8e0-f8c048fd3f93 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.195939 Oct 10 12:00:28.263600 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 80/168] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:28 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:29.264759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:29.265360 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:29.274768 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:29.275290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:29.276483 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:29.277191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:29.277643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:29.278240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:29.285310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:29.286240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:29.292365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:29.292863 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:29.293301 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:29.294003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:29.294458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:29.295041 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:29.821416 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:29.833209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:29.834105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-50fbf360-b215-4a2f-a2bb-e9752797b782 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1551 microversion: 2.1 time: 0.552010 Oct 10 12:00:29.843227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-40e6414f-6700-4a96-b82d-acbe853bf6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.582289 Oct 10 12:00:29.844127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 89/169] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:29 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:29.848739 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 81/170] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:29 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1551 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:30.355257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-ada0343e-0ea7-45e9-bbda-22eafaef082f req-b103e755-ef7d-4d29-8f02-d82c8ec1fbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5206ecbd-33e4-45ba-849b-408b6c33be7c", "name": "network-vif-deleted", "tag": "6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:30.365313 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ada0343e-0ea7-45e9-bbda-22eafaef082f req-b103e755-ef7d-4d29-8f02-d82c8ec1fbdf service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:30.366061 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ada0343e-0ea7-45e9-bbda-22eafaef082f req-b103e755-ef7d-4d29-8f02-d82c8ec1fbdf service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:30.366495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ada0343e-0ea7-45e9-bbda-22eafaef082f req-b103e755-ef7d-4d29-8f02-d82c8ec1fbdf service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:30.379030 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-ada0343e-0ea7-45e9-bbda-22eafaef082f req-b103e755-ef7d-4d29-8f02-d82c8ec1fbdf service nova] Creating event network-vif-deleted:6fd8e3b8-2ae6-41c2-82fd-290d2ae008d1 for instance 5206ecbd-33e4-45ba-849b-408b6c33be7c on hv-cinder-85061 Oct 10 12:00:30.384357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-ada0343e-0ea7-45e9-bbda-22eafaef082f req-b103e755-ef7d-4d29-8f02-d82c8ec1fbdf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033324 Oct 10 12:00:30.384961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 90/171] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:30.859256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:30.859877 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:30.866205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:30.866695 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:30.867164 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:30.867861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:30.868319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:30.868746 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:30.871219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:30.871931 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:30.877916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:30.878394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:30.878827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:30.879542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:30.879996 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:30.880417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:30.955565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:30.964946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-071c5d6a-3532-4f9a-a744-df44cbbea719 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1346 microversion: 2.1 time: 0.109405 Oct 10 12:00:30.966426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 82/172] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:30 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:31.061848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:31.070166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86a146df-fdba-4f4c-9382-12ac9ba62702 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.203160 Oct 10 12:00:31.070779 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 91/173] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:30 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:31.989953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:31.990565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:31.996661 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:31.997272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:31.997719 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:31.998404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:31.998863 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:31.999314 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:32.028731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:32.029273 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:32.029715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:32.030173 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lazy-loading 'fault' on Instance uuid 5206ecbd-33e4-45ba-849b-408b6c33be7c {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:00:32.073266 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8568f2501f824875bae7ab1825cc2c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fdf43bdef4f0dabd51175a84e9093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:32.081310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4cc44f17-2452-4bfe-9bb2-cfdaa6aea45c tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 200 len: 1351 microversion: 2.1 time: 0.095136 Oct 10 12:00:32.081876 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 83/174] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:31 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:32.094245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:32.094856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:32.101186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:32.101655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:32.102084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:32.102761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:32.103242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:32.104180 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:32.245058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:32.254181 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f681e5d6-56d0-4ed0-9ae1-d088b0d8afd1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.164125 Oct 10 12:00:32.255001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 92/175] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:32 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:33.105236 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:33.106114 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:33.112240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:33.112800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:33.113602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:33.114166 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:33.114623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:33.115079 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:33.128956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] HTTP exception thrown: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Request method failure captured: Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c HTTP/1.1 Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkb4l3TB_FUeGprUpEZDQf-zymy6XxQtFA8Q099_9EaKNGH6tZX6UhqipHY6sDm4tLOmCcBtT2ekfVI3yH67uvgx5-FwC2y0eg--qpB5E34iiKbEjz7BPKzpMrCzPRLw6EMJA5vwcPd9ICeEAKibnC51Vx0seTbw5_p-BLNoEgyLhM Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:00:33.133882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d57fdf43bdef4f0dabd51175a84e9093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}] Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 8568f2501f824875bae7ab1825cc2c32 Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.135803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '5206ecbd-33e4-45ba-849b-408b6c33be7c'} Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:33.136541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.137631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.138552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Returning 404 to user: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:33.138552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8edb0300-2b79-47f9-9ba2-debed328f6d4 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 404 len: 111 microversion: 2.1 time: 0.035637 Oct 10 12:00:33.138552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 84/176] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:33 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:00:33.251756 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:33.253888 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:33.260743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:33.261387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:33.261978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:33.262664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:33.263147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:33.263570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:33.276380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] HTTP exception thrown: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.277735 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:33.278345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:33.286157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Request method failure captured: Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c/os-volume_attachments HTTP/1.1 Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkb4l3TB_FUeGprUpEZDQf-zymy6XxQtFA8Q099_9EaKNGH6tZX6UhqipHY6sDm4tLOmCcBtT2ekfVI3yH67uvgx5-FwC2y0eg--qpB5E34iiKbEjz7BPKzpMrCzPRLw6EMJA5vwcPd9ICeEAKibnC51Vx0seTbw5_p-BLNoEgyLhM Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:00:33.286499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d57fdf43bdef4f0dabd51175a84e9093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}] Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 8568f2501f824875bae7ab1825cc2c32 Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.287685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'server_id': '5206ecbd-33e4-45ba-849b-408b6c33be7c'} Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:33.288326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:33.289335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:33.290387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:33.290387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:33.290534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Returning 404 to user: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:33.290611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:33.290681 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a85f3ded-d93c-462a-85aa-5579153ae0a9 tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040563 Oct 10 12:00:33.290755 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:33.290755 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:33.291987 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 93/177] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:00:33 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:00:33.455104 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:33.463071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1d2f85cb-f0e1-405b-bbf1-f43dd3960fdf tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.189118 Oct 10 12:00:33.463805 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 85/178] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:33 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:34.486628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:34.487446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:34.493863 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:34.494642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:34.495386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:34.496159 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:34.496692 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:34.497206 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:34.562162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:34.562679 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:34.588546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:34.589064 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:34.589514 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:34.596054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:34.596713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:34.597272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:34.619000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] HTTP exception thrown: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Request method failure captured: Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c HTTP/1.1 Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkb4l3TB_FUeGprUpEZDQf-zymy6XxQtFA8Q099_9EaKNGH6tZX6UhqipHY6sDm4tLOmCcBtT2ekfVI3yH67uvgx5-FwC2y0eg--qpB5E34iiKbEjz7BPKzpMrCzPRLw6EMJA5vwcPd9ICeEAKibnC51Vx0seTbw5_p-BLNoEgyLhM Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:00:34.620634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d57fdf43bdef4f0dabd51175a84e9093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}] Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 8568f2501f824875bae7ab1825cc2c32 Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.621763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '5206ecbd-33e4-45ba-849b-408b6c33be7c'} Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:34.622786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.624789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.626328 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Returning 404 to user: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:34.626328 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4025a5be-4225-4590-8fb3-f9a36e84718b tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 404 len: 111 microversion: 2.1 time: 0.066092 Oct 10 12:00:34.626328 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 86/179] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:00:34 2022] DELETE /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:00:34.632398 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:34.633773 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] [instance: 5206ecbd-33e4-45ba-849b-408b6c33be7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:34.642861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:34.643741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:34.644393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:34.646048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:34.647111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:34.647759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:34.680497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:34.681114 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] HTTP exception thrown: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Request method failure captured: Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c HTTP/1.1 Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkb4l3TB_FUeGprUpEZDQf-zymy6XxQtFA8Q099_9EaKNGH6tZX6UhqipHY6sDm4tLOmCcBtT2ekfVI3yH67uvgx5-FwC2y0eg--qpB5E34iiKbEjz7BPKzpMrCzPRLw6EMJA5vwcPd9ICeEAKibnC51Vx0seTbw5_p-BLNoEgyLhM Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:00:34.684052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d57fdf43bdef4f0dabd51175a84e9093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d57fdf43bdef4f0dabd51175a84e9093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d57fdf43bdef4f0dabd51175a84e9093"}]}] Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: d57fdf43bdef4f0dabd51175a84e9093 Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534435136 Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 8568f2501f824875bae7ab1825cc2c32 Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-DeleteServersTestJSON-1534435136-project Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.685368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '5206ecbd-33e4-45ba-849b-408b6c33be7c'} Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:34.686126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. Oct 10 12:00:34.687408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:34.688831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] Returning 404 to user: Instance 5206ecbd-33e4-45ba-849b-408b6c33be7c could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:34.690775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a80e2612-87ef-44e9-a66b-9168a028897f tempest-DeleteServersTestJSON-1534435136 tempest-DeleteServersTestJSON-1534435136-project] 10.222.0.52 "GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c" status: 404 len: 111 microversion: 2.1 time: 0.062183 Oct 10 12:00:34.691750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 87/180] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:34 2022] GET /compute/v2.1/servers/5206ecbd-33e4-45ba-849b-408b6c33be7c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:00:34.698184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f28cbe24-d983-434a-a9ef-ddc581711b40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.214186 Oct 10 12:00:34.698813 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 94/181] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:34 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:35.721469 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:35.725529 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:35.728996 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:35.729565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:35.730073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:35.730841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:35.731409 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:35.731907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:36.026533 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:36.037389 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b8e5a76-7a02-4f23-b910-b61445ee805b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.319214 Oct 10 12:00:36.038820 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 88/182] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:35 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:37.063763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:37.064380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:37.079325 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:37.081003 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:37.081485 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:37.083811 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:37.084822 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:37.086045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:37.430037 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:37.453609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6dc8f9c6-50ce-4c58-9fb8-f9540187b44a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.394244 Oct 10 12:00:37.454617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 95/183] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:37 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:38.494667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:38.495948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:38.510397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:38.511789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:38.512386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:38.513258 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:38.514860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:38.516287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:38.771143 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:38.782910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d5739082-1329-4beb-a7e6-2f2d248510aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.293052 Oct 10 12:00:38.783923 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 89/184] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:38 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:39.807162 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:39.808364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:39.815792 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:39.816769 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:39.817255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:39.817952 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:39.818588 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:39.819188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:39.823991 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:40.005438 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:40.016696 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ef7910b3-5888-4c87-927b-e9e53a2baa36 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.213617 Oct 10 12:00:40.018231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 96/185] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:39 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:40.803044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ef3b4182-a8ad-41eb-9616-ab4bc81756c1 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Action: 'create', calling method: .version_select at 0x7f862085de50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1011800412", "metadata": {"Type": "work"}}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ef3b4182-a8ad-41eb-9616-ab4bc81756c1 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Request method failure captured: Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 122 Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAlowSeHkb2mviOBs4eOTK3vMhJ98IrVmaKqYoIJDcqJrLHwLjUxF2ZOi32KDjBiF2w8FHpV8uw6N_n0llrslYm5GyFfmuAAc5TbRFPflmJIJ5VrE6P53fxEV64rmi7WDBMYo12v3dW8HtXBGdB_vms_otcwJM00Eu_cDTXAT0M6U54 Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:00:40.819751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abeb54035bdd44b4b04279b72be0e1e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}] Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f1e749fab7542469c7e53ef7d2cf632 Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1011800412", "metadata": {"Type": "work"}}} Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: Oct 10 12:00:40.821219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1011800412', 'metadata': {'Type': 'work'}}}} Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise error Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi '#$%' Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:40.822196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 12:00:40.823702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 12:00:40.824825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 12:00:40.824825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.824825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ef3b4182-a8ad-41eb-9616-ab4bc81756c1 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:40.824825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ef3b4182-a8ad-41eb-9616-ab4bc81756c1 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144159 Oct 10 12:00:40.826870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 90/186] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Oct 10 12:00:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:00:40.832071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-55c9e27d-1d37-4d36-9541-ef7eef9b4897 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Action: 'create', calling method: .version_select at 0x7f86208d00d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1245179419", "metadata": {"Type": "work"}}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-55c9e27d-1d37-4d36-9541-ef7eef9b4897 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Request method failure captured: Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 120 Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAlowSeHkb2mviOBs4eOTK3vMhJ98IrVmaKqYoIJDcqJrLHwLjUxF2ZOi32KDjBiF2w8FHpV8uw6N_n0llrslYm5GyFfmuAAc5TbRFPflmJIJ5VrE6P53fxEV64rmi7WDBMYo12v3dW8HtXBGdB_vms_otcwJM00Eu_cDTXAT0M6U54 Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:00:40.836821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abeb54035bdd44b4b04279b72be0e1e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}] Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f1e749fab7542469c7e53ef7d2cf632 Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1245179419", "metadata": {"Type": "work"}}} Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: Oct 10 12:00:40.840141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1245179419', 'metadata': {'Type': 'work'}}}} Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise error Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi '0' Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:40.841398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 12:00:40.843284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 12:00:40.844491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 12:00:40.844491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.844491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-55c9e27d-1d37-4d36-9541-ef7eef9b4897 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:40.844491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-55c9e27d-1d37-4d36-9541-ef7eef9b4897 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011196 Oct 10 12:00:40.844491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 97/187] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Oct 10 12:00:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:00:40.849001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3768444-e221-4233-84de-cf01545c1e0f tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Action: 'create', calling method: .version_select at 0x7f862084d8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1043937522", "metadata": {"Type": "work"}}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3768444-e221-4233-84de-cf01545c1e0f tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Request method failure captured: Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 119 Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAlowSeHkb2mviOBs4eOTK3vMhJ98IrVmaKqYoIJDcqJrLHwLjUxF2ZOi32KDjBiF2w8FHpV8uw6N_n0llrslYm5GyFfmuAAc5TbRFPflmJIJ5VrE6P53fxEV64rmi7WDBMYo12v3dW8HtXBGdB_vms_otcwJM00Eu_cDTXAT0M6U54 Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:00:40.852667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abeb54035bdd44b4b04279b72be0e1e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}] Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f1e749fab7542469c7e53ef7d2cf632 Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1043937522", "metadata": {"Type": "work"}}} Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: Oct 10 12:00:40.854834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1043937522', 'metadata': {'Type': 'work'}}}} Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise error Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi '' Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:40.856759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 12:00:40.858599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 12:00:40.862425 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 12:00:40.862425 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.862425 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3768444-e221-4233-84de-cf01545c1e0f tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:40.862425 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c3768444-e221-4233-84de-cf01545c1e0f tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009943 Oct 10 12:00:40.862425 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 91/188] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Oct 10 12:00:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:00:40.864300 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfaac17b-60ea-4c65-a8e4-2fa6d493d04e tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Calling method '.version_select at 0x7f86207f5ca0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:40.894525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-dfaac17b-60ea-4c65-a8e4-2fa6d493d04e tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] HTTP exception thrown: Volume tempest-invalid-1218044481 could not be found. Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfaac17b-60ea-4c65-a8e4-2fa6d493d04e tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Request method failure captured: Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1218044481 HTTP/1.1 Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAlowSeHkb2mviOBs4eOTK3vMhJ98IrVmaKqYoIJDcqJrLHwLjUxF2ZOi32KDjBiF2w8FHpV8uw6N_n0llrslYm5GyFfmuAAc5TbRFPflmJIJ5VrE6P53fxEV64rmi7WDBMYo12v3dW8HtXBGdB_vms_otcwJM00Eu_cDTXAT0M6U54 Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:00:40.896515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abeb54035bdd44b4b04279b72be0e1e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}] Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f1e749fab7542469c7e53ef7d2cf632 Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Volume tempest-invalid-1218044481 could not be found. Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'tempest-invalid-1218044481'} Oct 10 12:00:40.898070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1218044481 could not be found. (HTTP 404) (Request-ID: req-beb0289e-68c6-4325-9caf-32f0563f8e39) Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.898934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:00:40.900733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1218044481 could not be found. Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:40.901936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1218044481 could not be found. Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1218044481 could not be found. Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfaac17b-60ea-4c65-a8e4-2fa6d493d04e tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Returning 404 to user: Volume tempest-invalid-1218044481 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfaac17b-60ea-4c65-a8e4-2fa6d493d04e tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1218044481" status: 404 len: 99 microversion: 2.1 time: 0.037347 Oct 10 12:00:40.903272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 98/189] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Oct 10 12:00:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1218044481 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 12:00:40.909463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c64c5807-7b3c-4818-8e55-f634aafd97ab tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003891 Oct 10 12:00:40.910100 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 92/190] 10.222.0.52 () {58 vars in 1140 bytes} [Mon Oct 10 12:00:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 12:00:40.920708 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-821cfbbe-167c-4382-bbbe-bc0d8301b203 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004702 Oct 10 12:00:40.921341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 99/191] 10.222.0.52 () {58 vars in 1137 bytes} [Mon Oct 10 12:00:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 12:00:40.930648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7582f9e0-a0e7-44ce-8133-1cbdd96e5052 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Calling method '.version_select at 0x7f862085ddc0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:40.960639 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-7582f9e0-a0e7-44ce-8133-1cbdd96e5052 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] HTTP exception thrown: Volume f1640998-5268-4a87-98b4-03388fa91947 could not be found. Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7582f9e0-a0e7-44ce-8133-1cbdd96e5052 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Request method failure captured: Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/os-volumes/f1640998-5268-4a87-98b4-03388fa91947 HTTP/1.1 Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAlowSeHkb2mviOBs4eOTK3vMhJ98IrVmaKqYoIJDcqJrLHwLjUxF2ZOi32KDjBiF2w8FHpV8uw6N_n0llrslYm5GyFfmuAAc5TbRFPflmJIJ5VrE6P53fxEV64rmi7WDBMYo12v3dW8HtXBGdB_vms_otcwJM00Eu_cDTXAT0M6U54 Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:00:40.966277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abeb54035bdd44b4b04279b72be0e1e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}] Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f1e749fab7542469c7e53ef7d2cf632 Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Volume f1640998-5268-4a87-98b4-03388fa91947 could not be found. Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': 'f1640998-5268-4a87-98b4-03388fa91947'} Oct 10 12:00:40.967747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1640998-5268-4a87-98b4-03388fa91947 could not be found. (HTTP 404) (Request-ID: req-e43dff3d-c159-4353-93fe-aae13b924c79) Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.973248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:00:40.974503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1640998-5268-4a87-98b4-03388fa91947 could not be found. Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 12:00:40.975932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1640998-5268-4a87-98b4-03388fa91947 could not be found. Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1640998-5268-4a87-98b4-03388fa91947 could not be found. Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7582f9e0-a0e7-44ce-8133-1cbdd96e5052 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Returning 404 to user: Volume f1640998-5268-4a87-98b4-03388fa91947 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7582f9e0-a0e7-44ce-8133-1cbdd96e5052 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f1640998-5268-4a87-98b4-03388fa91947" status: 404 len: 109 microversion: 2.1 time: 0.041419 Oct 10 12:00:40.977190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 93/192] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:00:40 2022] DELETE /compute/v2.1/os-volumes/f1640998-5268-4a87-98b4-03388fa91947 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:00:40.978255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-671e0e3e-2a8c-4121-b9a5-2d81444149e3 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Calling method '.version_select at 0x7f8620b73430>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:41.012337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-671e0e3e-2a8c-4121-b9a5-2d81444149e3 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] HTTP exception thrown: Volume dcd7ac7c-5249-4049-bda7-c68a6ab48be7 could not be found. Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-671e0e3e-2a8c-4121-b9a5-2d81444149e3 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Request method failure captured: Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/dcd7ac7c-5249-4049-bda7-c68a6ab48be7 HTTP/1.1 Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAlowSeHkb2mviOBs4eOTK3vMhJ98IrVmaKqYoIJDcqJrLHwLjUxF2ZOi32KDjBiF2w8FHpV8uw6N_n0llrslYm5GyFfmuAAc5TbRFPflmJIJ5VrE6P53fxEV64rmi7WDBMYo12v3dW8HtXBGdB_vms_otcwJM00Eu_cDTXAT0M6U54 Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:00:41.014273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abeb54035bdd44b4b04279b72be0e1e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abeb54035bdd44b4b04279b72be0e1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abeb54035bdd44b4b04279b72be0e1e0"}]}] Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: abeb54035bdd44b4b04279b72be0e1e0 Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-752400945 Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f1e749fab7542469c7e53ef7d2cf632 Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-752400945-project Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Volume dcd7ac7c-5249-4049-bda7-c68a6ab48be7 could not be found. Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'dcd7ac7c-5249-4049-bda7-c68a6ab48be7'} Oct 10 12:00:41.015717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dcd7ac7c-5249-4049-bda7-c68a6ab48be7 could not be found. (HTTP 404) (Request-ID: req-0b928249-619e-4ec2-a971-dd89df44b82b) Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:41.016675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:00:41.017883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dcd7ac7c-5249-4049-bda7-c68a6ab48be7 could not be found. Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 12:00:41.019073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dcd7ac7c-5249-4049-bda7-c68a6ab48be7 could not be found. Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dcd7ac7c-5249-4049-bda7-c68a6ab48be7 could not be found. Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-671e0e3e-2a8c-4121-b9a5-2d81444149e3 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] Returning 404 to user: Volume dcd7ac7c-5249-4049-bda7-c68a6ab48be7 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-671e0e3e-2a8c-4121-b9a5-2d81444149e3 tempest-VolumesNegativeTest-752400945 tempest-VolumesNegativeTest-752400945-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/dcd7ac7c-5249-4049-bda7-c68a6ab48be7" status: 404 len: 109 microversion: 2.1 time: 0.041917 Oct 10 12:00:41.020271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 100/193] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:00:40 2022] GET /compute/v2.1/os-volumes/dcd7ac7c-5249-4049-bda7-c68a6ab48be7 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:00:41.041959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:41.042531 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:41.049696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:41.050259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:41.050883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:41.051868 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:41.052394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:41.052969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:41.208138 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:41.217829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1006ed90-3bb2-49bb-a68a-0cc2476f83b3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.181039 Oct 10 12:00:41.218514 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 94/194] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:41 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:41.805108 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-744524754", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:41.866843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] validate_networks() for None {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:00:42.173144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:00:42.173726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:00:42.175272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:00:42.175780 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:00:42.176124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:00:42.186133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:42.186613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:42.187077 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:42.187800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:42.188247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:42.188665 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:42.212116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Getting quotas for project 132383472a4f48779d8c4fc5a5179a8e. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:00:42.217088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Getting quotas for user ef293aceb5e7483f9d69a4eab9e187fa and project 132383472a4f48779d8c4fc5a5179a8e. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:00:42.230099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:00:42.232470 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:00:42.247221 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:42.247935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:42.262104 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:42.263672 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:42.264135 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:42.264853 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:42.265323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:42.266365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:42.283333 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9c43fac9-ff70-48c4-a06c-4d2b945970c4 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488628 Oct 10 12:00:42.284288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 101/195] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:00:42.295380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b3b7baff-0fdd-4028-acc9-bfc35f4a48dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:42.297607 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b3b7baff-0fdd-4028-acc9-bfc35f4a48dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:42.658805 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b3b7baff-0fdd-4028-acc9-bfc35f4a48dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:42.669265 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b3b7baff-0fdd-4028-acc9-bfc35f4a48dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1214 microversion: 2.1 time: 0.378245 Oct 10 12:00:42.675016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 102/196] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:42 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1214 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:42.729386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:42.752311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1eedabd0-26e0-4675-a0f7-f90de7ed38cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.514286 Oct 10 12:00:42.753137 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 95/197] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:42 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:43.702480 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:43.703129 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:43.717044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:43.717529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:43.718077 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:43.725218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:43.725693 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:43.726126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:43.783669 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:43.784798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:43.791651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:43.791814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:43.792147 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:43.792580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:43.793379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:43.793899 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:43.794329 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:43.800980 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ede2b48c-7957-431d-8504-6203c6f8a1a5 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1218 microversion: 2.1 time: 0.102287 Oct 10 12:00:43.806949 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 103/198] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:43 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:43.926463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:43.934769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8d19136c-fd61-4c71-9e13-2bea96a1cd54 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.161587 Oct 10 12:00:43.935374 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 96/199] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:43 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:44.824636 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:44.825344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:44.828395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:44.834636 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:44.835156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:44.835597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:44.836298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:44.836761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:44.837188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:44.905640 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:44.913818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d455c887-7fac-4233-ace1-54209425b4e1 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1218 microversion: 2.1 time: 0.093658 Oct 10 12:00:44.927439 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 104/200] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:44 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:44.960754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:44.961875 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:44.968951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:44.969508 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:44.970072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:44.971571 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:44.972203 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:44.972500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:45.105233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:45.113054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f1bee5a3-5b1d-4682-89ef-61cf74cb7a79 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.156829 Oct 10 12:00:45.113619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 97/201] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:44 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:45.939433 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:45.940804 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:45.948432 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:45.949051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:45.949558 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:45.950388 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:45.950930 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:45.951469 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:46.040549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:46.050215 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e42f29db-23b1-430d-a9c7-cccb38cbc44b tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1284 microversion: 2.1 time: 0.114504 Oct 10 12:00:46.051034 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 105/202] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:45 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:46.137573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:46.138204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:46.144273 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:46.144701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:46.145131 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:46.145827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:46.146306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:46.146722 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:46.410000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:46.419400 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2c6f9ca2-3184-405b-b633-11dddd918449 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.286415 Oct 10 12:00:46.419989 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 98/203] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:46 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:47.074355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:47.074885 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:47.081179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:47.081656 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:47.082084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:47.082769 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:47.083247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:47.083661 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:47.328716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:47.336715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fc358dfc-f293-4957-8765-d374360ff0f6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.266874 Oct 10 12:00:47.337277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 106/204] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:47 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:47.446453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:47.447253 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:47.454526 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:47.455482 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:47.455980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:47.456915 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:47.457476 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:47.457980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:47.681385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:47.689838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-50a48ca2-977c-4cc4-b111-2c6977b200f1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.247907 Oct 10 12:00:47.690406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 99/205] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:47 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:47.824679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-d02b3fdd-0cab-4821-a9d9-e4b68a7e1bc1 req-b4ba730f-e24c-4bf1-938a-acb61939cde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f42d94a-65e4-4b68-9f46-1b37f5291cfa", "tag": "52893d18-e50a-435f-a0f5-a5691c10b280"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:47.835219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d02b3fdd-0cab-4821-a9d9-e4b68a7e1bc1 req-b4ba730f-e24c-4bf1-938a-acb61939cde2 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:47.836380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d02b3fdd-0cab-4821-a9d9-e4b68a7e1bc1 req-b4ba730f-e24c-4bf1-938a-acb61939cde2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:47.836380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d02b3fdd-0cab-4821-a9d9-e4b68a7e1bc1 req-b4ba730f-e24c-4bf1-938a-acb61939cde2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:47.849117 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-d02b3fdd-0cab-4821-a9d9-e4b68a7e1bc1 req-b4ba730f-e24c-4bf1-938a-acb61939cde2 service nova] Creating event network-changed:52893d18-e50a-435f-a0f5-a5691c10b280 for instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa on hv-cinder-85061 Oct 10 12:00:47.854414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-d02b3fdd-0cab-4821-a9d9-e4b68a7e1bc1 req-b4ba730f-e24c-4bf1-938a-acb61939cde2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Oct 10 12:00:47.855427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 107/206] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:48.359340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:48.359956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:48.365967 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:48.366460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:48.366916 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:48.367620 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:48.368078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:48.369000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:48.513865 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:48.521686 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b41c3f79-4c5c-4aeb-bf98-e176c0d3eb98 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.166185 Oct 10 12:00:48.522348 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 100/207] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:48 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:48.715301 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:48.715922 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:48.722524 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:48.723053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:48.723492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:48.724190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:48.724648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:48.725074 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:48.852189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:48.862217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a48377a8-6c8f-4632-87d4-836cfdb1e78a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.151191 Oct 10 12:00:48.862787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 108/208] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:48 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:49.544595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:49.545278 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:49.551573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:49.552138 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:49.552668 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:49.553687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:49.554217 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:49.554716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:49.557939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:49.693541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:49.701486 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-42ff18a7-1bbd-4c60-9626-1f3935b04bcb tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.161281 Oct 10 12:00:49.702091 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 101/209] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:49 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:49.885419 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:49.886170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:49.892670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:49.893190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:49.893695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:49.894350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:49.894806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:49.895266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:50.094047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:50.101623 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-85f07dc1-af60-4e4c-9b62-bc67e45f4156 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.220257 Oct 10 12:00:50.102179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 109/210] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:49 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:50.724937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:50.725606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:50.733016 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:50.733583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:50.734024 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:50.735007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:50.735535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:50.736031 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:50.893815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:50.902386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c89a0612-4c6f-4078-979d-dbdd657705e3 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.182034 Oct 10 12:00:50.902999 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 102/211] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:50 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:51.124829 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:51.125533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:51.132485 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:51.132964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:51.133395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:51.134567 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:51.135062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:51.135488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:51.273772 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:51.281518 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-effe4b28-2d37-4a14-9133-00faaba15705 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.160738 Oct 10 12:00:51.282085 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 110/212] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:51 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:51.925620 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:51.926151 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:51.932884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:51.933362 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:51.933795 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:51.934511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:51.934998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:51.935427 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:52.063819 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:52.073267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-099736eb-a78f-4fb9-8427-1fcd3ab491de tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.151586 Oct 10 12:00:52.073847 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 103/213] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:51 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:52.304701 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:52.305315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:52.307983 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:52.313367 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:52.313851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:52.314426 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:52.315179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:52.315637 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:52.316056 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:52.450335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:52.459182 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bca4c681-5090-4785-981d-c76ba8249886 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.158536 Oct 10 12:00:52.459759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 111/214] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:52 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:53.097138 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:53.097710 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:53.104082 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:53.104565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:53.105000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:53.105685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:53.106140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:53.106564 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:53.234745 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:53.242431 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c1d3083e-bc7a-4853-81e0-d9ab0b74d3b7 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.149185 Oct 10 12:00:53.243037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 104/215] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:53 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:53.484434 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:53.485470 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:53.487396 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=8 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:53.493263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:53.493797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:53.494572 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:53.495541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:53.495993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:53.496415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:53.723417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:53.732368 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6656175f-761a-4e80-b791-536f62336045 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.252212 Oct 10 12:00:53.733144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 112/216] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:53 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:54.266861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:54.267509 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:54.272233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=54 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:54.274128 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:54.274664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:54.275123 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:54.275811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:54.276259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:54.276687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:54.418848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:54.426548 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-430ee44a-cddb-4f35-b104-cda82bb49876 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.164145 Oct 10 12:00:54.427155 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 105/217] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:54 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:54.755594 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:54.756324 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:54.763275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:54.763939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:54.764370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:54.765053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:54.765507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:54.766123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:54.914740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:54.923407 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-342db50a-9be5-4073-876f-8acfb3d11907 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.171903 Oct 10 12:00:54.924155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 113/218] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:54 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:55.451539 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:55.452232 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:55.458487 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:55.459005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:55.459498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:55.460184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:55.460634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:55.461053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:55.591247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:55.598813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1c9bef21-cd5d-4d08-8302-f649b6aa8159 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.151130 Oct 10 12:00:55.599394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 106/219] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:55 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:55.952136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:55.953607 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:55.961051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:55.961494 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:55.964151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:55.965162 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:55.965588 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:55.966016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:56.085288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f7e82b87-1c63-4ba1-9963-a06d9f1fb557 req-7e9cfb5a-69fb-464b-a2c5-873456dc4531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f42d94a-65e4-4b68-9f46-1b37f5291cfa", "name": "network-vif-plugged", "status": "completed", "tag": "52893d18-e50a-435f-a0f5-a5691c10b280"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:56.096356 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f7e82b87-1c63-4ba1-9963-a06d9f1fb557 req-7e9cfb5a-69fb-464b-a2c5-873456dc4531 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:56.097883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f7e82b87-1c63-4ba1-9963-a06d9f1fb557 req-7e9cfb5a-69fb-464b-a2c5-873456dc4531 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:56.098657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f7e82b87-1c63-4ba1-9963-a06d9f1fb557 req-7e9cfb5a-69fb-464b-a2c5-873456dc4531 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:56.127208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f7e82b87-1c63-4ba1-9963-a06d9f1fb557 req-7e9cfb5a-69fb-464b-a2c5-873456dc4531 service nova] Creating event network-vif-plugged:52893d18-e50a-435f-a0f5-a5691c10b280 for instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa on hv-cinder-85061 Oct 10 12:00:56.137500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f7e82b87-1c63-4ba1-9963-a06d9f1fb557 req-7e9cfb5a-69fb-464b-a2c5-873456dc4531 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055603 Oct 10 12:00:56.139342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 107/220] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:56.147658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:56.155754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a1e48ba4-fda3-43ff-963f-9d8e68e06d7c tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.208826 Oct 10 12:00:56.171775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 114/221] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:55 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:56.621263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:56.621968 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:56.628012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:56.628504 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:56.628945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:56.629644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:56.630105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:56.630884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:56.775347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:56.783896 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4fb2f3bf-2b73-47e5-9bbe-756020907f71 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.166872 Oct 10 12:00:56.784466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 108/222] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:56 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:57.183427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:57.184066 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:57.193940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:57.194435 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:57.194979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:57.195591 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:57.196050 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:57.197182 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:57.333129 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:57.340904 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-04d7e218-5ae9-411a-95e2-ebab6d7ca0a2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.163165 Oct 10 12:00:57.351236 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 115/223] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:57 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:57.807187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:57.807797 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:57.813613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:57.814121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:57.814553 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:57.815292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:57.815745 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:57.816160 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:57.944310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:57.952969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f8b06c43-f843-4527-97a2-b170ec5ce29e tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.149949 Oct 10 12:00:57.953551 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 109/224] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:57 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:58.364231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:58.365314 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:58.373172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:58.373705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:58.374181 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:58.374983 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:58.375589 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:58.376288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:58.536698 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:58.546396 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-65c29c01-90c5-4b5f-99f4-4bb66ae7e63b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.187169 Oct 10 12:00:58.547153 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 116/225] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:58 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:58.975540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:58.977219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:58.984468 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:58.985267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:58.985707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:58.986400 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:58.986852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:58.987356 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:59.125689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:59.134182 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-14defeda-cbda-4745-a8e4-d412b3903822 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.162683 Oct 10 12:00:59.134757 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 110/226] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:58 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:59.569667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:59.570277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:59.578110 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:59.578598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:59.579260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:59.579961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:59.580417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:59.580853 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:59.777490 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:59.786971 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f324a160-c07d-4d1c-9e59-8b7d44e290fd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.221091 Oct 10 12:00:59.787886 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 117/227] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:59 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:00.157775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:00.158527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:00.176541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:00.178415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:00.178872 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:00.179691 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:00.181254 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:00.181781 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:00.635115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:00.651515 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3a22f56c-2b5c-43f8-b202-2f275c817a27 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1314 microversion: 2.1 time: 0.497971 Oct 10 12:01:00.652422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 111/228] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:00 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:00.812059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:00.812665 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:00.822679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:00.825499 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:00.827233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:00.828174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:00.832911 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:00.833926 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:01.259699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:01.285063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-477c50b4-7c3c-41f3-8960-e3b68b991590 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.476757 Oct 10 12:01:01.286418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 118/229] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:00 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:01.682872 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:01.685625 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:01.687297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:01.687798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:01.696330 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:01.696719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:01.697205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:01.697345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:01.697643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:01.698117 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:01.698369 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:01.699037 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:01.699461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:01.700280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:01.700909 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:01.702624 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:01.704430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:01.734777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fa0ea837-8a3f-42e8-be26-7ad8aad60635 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/ips" status: 200 len: 151 microversion: 2.20 time: 0.051587 Oct 10 12:01:01.736026 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 119/230] 10.222.0.52 () {60 vars in 1289 bytes} [Mon Oct 10 12:01:01 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:01:02.006497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:02.017959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3ad6fdd5-eb1d-4b2d-b0e8-503f88840249 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1463 microversion: 2.1 time: 0.348008 Oct 10 12:01:02.019183 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 112/231] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:01 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1463 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:02.148334 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:02.148882 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:02.172201 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:02.172531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:02.177048 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:02.179204 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:02.181327 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:02.182141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:02.241079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:01:02.309443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:02.310056 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:02.319441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:02.320939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:02.322271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:02.323188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:02.323792 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:02.324384 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:02.407203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1988b96a-7eca-4ab2-9940-468ee44cbd2c tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 204 len: 0 microversion: 2.1 time: 0.265077 Oct 10 12:01:02.411597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 120/232] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:01:02 2022] DELETE /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:01:02.419043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:02.421061 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:02.432228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:02.432932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:02.433910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:02.434807 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:02.435325 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:02.435753 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:02.563806 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:02.581338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8fde27b3-e589-4447-bdb8-0187d91bb9a3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.275450 Oct 10 12:01:02.590932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 113/233] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:02 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:02.640508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:02.650627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-edf227f1-8bc0-46c3-b032-33416efa5544 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1469 microversion: 2.1 time: 0.237069 Oct 10 12:01:02.651532 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 121/234] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:02 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:03.613652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:03.614654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:03.626866 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:03.629960 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:03.630410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:03.634405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:03.635341 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:03.636091 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:03.680125 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:03.681350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:03.689628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:03.690183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:03.690720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:03.691441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:03.692120 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:03.693210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:04.037771 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:04.047766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4ed9e95a-b97d-425f-8e99-9986a5e30a97 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.446045 Oct 10 12:01:04.048354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 114/235] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:03 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:04.076075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:04.084386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8f07303e-93f9-4512-b540-5af66ad38ac6 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1469 microversion: 2.1 time: 0.411789 Oct 10 12:01:04.088712 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 122/236] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:03 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:04.534353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:04.536189 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:04.547348 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:04.548346 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:04.548988 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:04.563707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:04.564708 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:04.565395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:04.621883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lazy-loading 'flavor' on Instance uuid 37bc3237-f592-4db7-9f6a-294f4cea3c9a {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:01:05.077910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:05.078585 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:05.094170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:05.097676 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:05.098147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:05.103920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:05.104462 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:05.109368 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:05.200274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-69fd3ffb-301b-46b8-8632-149f467e5475 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/action" status: 202 len: 0 microversion: 2.20 time: 0.665365 Oct 10 12:01:05.205214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 115/237] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Oct 10 12:01:04 2022] POST /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:01:05.213917 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:05.214628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:05.223178 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:05.223678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:05.224118 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:05.224829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:05.225285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:05.226256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:05.250779 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:05.657497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:05.671671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0b40af04-99ea-4605-827f-d0db85a9f708 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.597835 Oct 10 12:01:05.684273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 123/238] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:05 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:05.699362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:05.699986 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:05.700418 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:05.731062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:05.732991 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98b1b3dc-b675-44f1-a757-c6ddea9c22dc tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1469 microversion: 2.1 time: 0.526914 Oct 10 12:01:05.733591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 116/239] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:05 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1469 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:05.734159 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:05.734714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:05.735538 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:05.735997 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:05.736556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:05.968055 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-2fe6662d-eee3-46bf-bfc3-54269941a9f8 req-3cb1ff36-14ac-412a-b13e-377260ee1286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f42d94a-65e4-4b68-9f46-1b37f5291cfa", "name": "network-vif-deleted", "tag": "52893d18-e50a-435f-a0f5-a5691c10b280"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:05.996031 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2fe6662d-eee3-46bf-bfc3-54269941a9f8 req-3cb1ff36-14ac-412a-b13e-377260ee1286 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:05.996512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2fe6662d-eee3-46bf-bfc3-54269941a9f8 req-3cb1ff36-14ac-412a-b13e-377260ee1286 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:05.996941 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2fe6662d-eee3-46bf-bfc3-54269941a9f8 req-3cb1ff36-14ac-412a-b13e-377260ee1286 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:06.040922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-2fe6662d-eee3-46bf-bfc3-54269941a9f8 req-3cb1ff36-14ac-412a-b13e-377260ee1286 service nova] Creating event network-vif-deleted:52893d18-e50a-435f-a0f5-a5691c10b280 for instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa on hv-cinder-85061 Oct 10 12:01:06.054939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-2fe6662d-eee3-46bf-bfc3-54269941a9f8 req-3cb1ff36-14ac-412a-b13e-377260ee1286 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090379 Oct 10 12:01:06.062877 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 117/240] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:01:06.151779 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:06.164334 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:06.167035 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:06.168422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-739c2cc6-5a02-4b3b-acac-8a89ceb8b0d8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.483025 Oct 10 12:01:06.169280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 124/241] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:05 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:06.703034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:06.703791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:06.715669 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:06.720840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:06.723385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:06.724934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:06.726385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:06.729007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:06.761790 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:06.762415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:06.771023 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:06.771487 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:06.775596 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:06.776588 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:06.777216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:06.782697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:06.996184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef293aceb5e7483f9d69a4eab9e187fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132383472a4f48779d8c4fc5a5179a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:07.006172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2ee0f794-fc4a-429c-846f-29f4aa807438 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 200 len: 1299 microversion: 2.1 time: 0.249452 Oct 10 12:01:07.027083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 125/242] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:06 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:07.139836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:07.148952 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-28aa987a-57ce-477d-8f1e-b011efb1562e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1521 microversion: 2.1 time: 0.450870 Oct 10 12:01:07.173611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 118/243] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:06 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:07.196873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:07.197972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:07.206094 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:07.207422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:07.209166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:07.210120 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:07.212339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:07.213125 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:07.255894 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:07.256396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:07.268724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:07.269438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:07.269881 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:07.270592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:07.277410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:07.277965 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:07.319273 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-277a203a-349f-411a-9bba-03ac63ecece6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/ips" status: 200 len: 149 microversion: 2.1 time: 0.066977 Oct 10 12:01:07.319961 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 119/244] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:01:07 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/ips => generated 149 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:01:07.446852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:07.456057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:07.457742 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:07.459135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-587a4d62-765c-4dea-a319-4812739ce5c6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.266872 Oct 10 12:01:07.472461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 126/245] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:07 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:08.037699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:08.038976 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] [instance: 2f42d94a-65e4-4b68-9f46-1b37f5291cfa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:08.049352 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.049851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.050299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.051051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.051512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.051937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.077846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] HTTP exception thrown: Instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa could not be found. Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Request method failure captured: Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa HTTP/1.1 Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAlmMurdM0sugVhshITmDNgDTdaeflXdLhvoCe-zV-tGW4tQ7QhfTyCzD_BEbiDMG2_lNWs3wvLLSDYC859hNWPDvj04_jWlzgo1BB8ZGHEYMbuJZqLgjgafpPZ-IOfoNoVEE44_BsikOkKfj1U4cK7QC5oAn_ebcBAbH5hiHGpj4cw Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 132383472a4f48779d8c4fc5a5179a8e Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-914502378 Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:01:08.079610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/132383472a4f48779d8c4fc5a5179a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_132383472a4f48779d8c4fc5a5179a8e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/132383472a4f48779d8c4fc5a5179a8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/132383472a4f48779d8c4fc5a5179a8e"}]}] Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-914502378 Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 132383472a4f48779d8c4fc5a5179a8e Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-914502378 Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-914502378-project Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: ef293aceb5e7483f9d69a4eab9e187fa Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-914502378-project Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa could not be found. Oct 10 12:01:08.081192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '2f42d94a-65e4-4b68-9f46-1b37f5291cfa'} Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa could not be found. Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:08.082052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa could not be found. Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa could not be found. Oct 10 12:01:08.083397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:08.085704 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] Returning 404 to user: Instance 2f42d94a-65e4-4b68-9f46-1b37f5291cfa could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:08.087316 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8a76c299-5050-4521-a84c-8e7f949481f2 tempest-VolumesNegativeTest-914502378 tempest-VolumesNegativeTest-914502378-project] 10.222.0.52 "GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa" status: 404 len: 111 microversion: 2.1 time: 0.053046 Oct 10 12:01:08.088063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 120/246] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:08 2022] GET /compute/v2.1/servers/2f42d94a-65e4-4b68-9f46-1b37f5291cfa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:01:08.199285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:08.200235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:08.216942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.218988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.221526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.223907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.225355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.226360 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.488582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:08.496606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:08.498521 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:08.510927 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6455ae57-7106-478e-952b-97f73ecd6ef0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1501 microversion: 2.1 time: 0.318666 Oct 10 12:01:08.518083 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.518958 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.520752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.521801 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.522262 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.522690 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.529893 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 127/247] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:08 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:08.538660 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:08.540440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:08.556126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.557121 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.559051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.563716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:08.564912 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:08.567972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:08.875410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:08.890495 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:08.892090 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:08.902881 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a1529d3b-44ee-41db-aacf-4abc32b39473 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.411574 Oct 10 12:01:08.904952 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 121/248] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:08 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:08.913910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:08.924784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f607bca1-d787-410a-bd92-0f0682ed04c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1515 microversion: 2.1 time: 0.392953 Oct 10 12:01:08.930020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 128/249] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:08 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:08.998843 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "978bc04e-e74f-4841-b456-33236d73f2c5"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:09.001949 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:09.018216 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:09.018825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:09.019400 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:09.020208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:09.020940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:09.022084 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:09.641806 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7b5c3a24-a423-481b-b7cb-e310de17c77a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647168 Oct 10 12:01:09.642700 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 122/250] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:01:08 2022] POST /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:09.936950 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:09.943908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:09.954727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:09.955429 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:09.956156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:09.957251 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:09.957919 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:09.958501 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:10.430357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:10.445166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:10.447528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:10.450842 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-71a7ee06-ec7f-4565-9211-26c001852159 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.521046 Oct 10 12:01:10.453853 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 129/251] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:09 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:10.807029 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:10.813747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:10.845188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:10.849062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:10.851493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:10.854758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:10.855233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:10.855686 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:11.184906 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'flavor' on Instance uuid 0079dd21-134c-4eba-b98a-5e223f5bfb49 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:01:11.311966 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-14e52096-1103-49c7-9c99-558d9088634d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49/action" status: 200 len: 32 microversion: 2.1 time: 0.511078 Oct 10 12:01:11.312971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 123/252] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:01:10 2022] POST /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49/action => generated 32 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:01:11.322856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:11.323507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:11.345405 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:11.345906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:11.346346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:11.353441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:11.354104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:11.356234 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:11.484525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:11.486458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:11.495996 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:11.496696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:11.497345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:11.498360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:11.499251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:11.500178 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:11.697419 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:11.705861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d21af01-19ce-4661-a070-55fabcc5964b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.387460 Oct 10 12:01:11.710441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 130/253] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:11 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:11.723782 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:11.728654 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:11.735245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:11.735939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:11.736387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:11.737088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:11.737882 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:11.738575 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:11.814698 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eac74bad-b464-4976-84c3-d7515491495a tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/ips" status: 200 len: 145 microversion: 2.1 time: 0.101776 Oct 10 12:01:11.823338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 131/254] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:01:11 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/ips => generated 145 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:12.204629 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:12.216457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:12.217928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:12.223619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8af568f0-9086-48f6-aeff-52f7005118ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.741938 Oct 10 12:01:12.224397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 124/255] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:11 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:12.729633 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:12.733427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:12.746603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:12.747393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:12.748342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:12.749302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:12.750132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:12.751164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:13.074286 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:13.082300 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-571c9d04-687f-4bfc-980c-afab7b5d2be3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.356679 Oct 10 12:01:13.082873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 132/256] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:12 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:13.249915 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:13.250533 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:13.264708 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:13.265584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:13.266032 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:13.266745 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:13.267229 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:13.271994 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:13.505353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:13.517658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:13.522654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:13.525278 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f1a0d4fc-932e-4d95-a4bf-e0e9d38c1fb5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.279211 Oct 10 12:01:13.528647 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 125/257] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:13 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:14.107298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:14.108827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:14.122855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:14.123295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:14.124190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:14.125184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:14.125778 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:14.132500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:14.314386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:14.322870 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24794938-4a74-40ed-8950-781abe93f837 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.219738 Oct 10 12:01:14.323777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 133/258] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:14 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:14.552414 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:14.553276 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:14.560547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:14.561296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:14.561887 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:14.562765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:14.563421 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:14.563998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:14.711023 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:14.719898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:14.722846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:14.724250 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f47ab173-b40a-46be-9b21-c80384e3b215 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.175772 Oct 10 12:01:14.725318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 126/259] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:14 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:15.362824 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:15.364256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:15.392790 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:15.420645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:15.425220 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:15.426157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:15.427334 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:15.428454 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:15.429130 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:15.663467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:15.667481 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:15.676478 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-afefcf2e-7047-4eb8-9565-0d7645f38aea tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.319492 Oct 10 12:01:15.678214 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 134/260] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:15 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:15.749456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:15.750067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:15.762243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:15.762742 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:15.763202 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:15.763904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:15.768035 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:15.768664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:15.927037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:15.938647 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:15.940461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:15.941677 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-73e4c672-6e38-4ed5-b81f-4dc069cee169 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.196556 Oct 10 12:01:15.945547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 127/261] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:15 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:16.706088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:16.706741 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:16.722917 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:16.723424 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:16.727717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:16.728690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:16.729170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:16.729609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:16.915933 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:16.925798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-563a45ae-4006-4aef-a718-a09295422f3b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.224927 Oct 10 12:01:16.926382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 135/262] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:16 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:16.970052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:16.970584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:16.978024 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:16.978514 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:16.979181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:16.980053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:16.980511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:16.981123 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:17.153779 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:17.162939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:17.165124 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:17.166405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3dbc510a-0c50-4ca0-8794-6c87dfb33c5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.200759 Oct 10 12:01:17.179479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 128/263] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:16 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:17.284175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b160e43-6fd4-44a5-9993-eceec7220d23"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:17.287352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:17.297341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:17.298041 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:17.298486 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:17.299678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:17.300490 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:17.301133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:17.746771 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-21d14f04-8cab-48ef-a499-28a48ea247e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466403 Oct 10 12:01:17.760974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 136/264] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:01:17 2022] POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:17.773355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd566e0c-5fe4-41ca-9e95-2e68085fb92f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: .version_select at 0x7f86207feaf0>, body: {"keypair": {"name": "tempest-keypair-1450129352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyh/CR/CDvUVbm5w1je9xZGO7UW5YlPZzlNflLWlKxhDfZ1ebW5655UWYn1hC8B76U4kiVz7LKIl1XzVoTiN2K5PJ+mCY155Mo+tqXQot4GEHeqNPH06NlxRDiL26jqQQ=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:17.813604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bd566e0c-5fe4-41ca-9e95-2e68085fb92f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:01:17.832258 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bd566e0c-5fe4-41ca-9e95-2e68085fb92f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:01:17.871380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd566e0c-5fe4-41ca-9e95-2e68085fb92f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102240 Oct 10 12:01:17.872873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 129/265] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:01:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:17.954105 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:17.955554 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:17.970124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:17.970629 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:17.972959 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:17.975872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:17.976568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:17.977617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:18.181956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:18.194551 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-564e02d9-79bc-4b0c-8a19-f5a067dd4236 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.247421 Oct 10 12:01:18.195096 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:18.196911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:18.210490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:18.213861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:18.214351 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 137/266] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:17 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:18.215381 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:18.217002 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:18.218614 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:18.220707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:18.466435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:18.475205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:18.476937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:18.479219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b9e1a96b-1e6a-4c53-9165-8f469924fd17 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.289757 Oct 10 12:01:18.480434 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 130/267] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:18 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:19.221677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:19.222257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:19.229215 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:19.229673 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:19.235518 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:19.237844 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:19.238463 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:19.251481 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:19.512392 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:19.513095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:19.525404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:19.525898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:19.526347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:19.527106 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:19.527519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:19.527953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:19.582210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:19.590592 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-89a2290f-8efa-4534-9613-642f17077ec3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.372744 Oct 10 12:01:19.591196 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 138/268] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:19 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:19.794941 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:19.809353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:19.811613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:19.813530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-22818ece-0204-4d09-af2b-a33f42b0c96c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.306087 Oct 10 12:01:19.814621 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 131/269] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:19 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:19.918259 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-380050653", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05a9786c-a8d0-4fea-bd0d-744e4b7d958a"}], "security_groups": [{"name": "tempest-securitygroup--1223450881"}], "key_name": "tempest-keypair-1450129352", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:20.096366 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] validate_networks() for [('05a9786c-a8d0-4fea-bd0d-744e4b7d958a', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:01:20.578482 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:01:20.579647 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:01:20.580542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:01:20.581248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:01:20.581939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:01:20.597525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:20.598355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:20.598827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:20.599818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:20.600429 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:20.601076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:20.616193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:20.617399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:20.627573 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:01:20.631992 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:01:20.636927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:20.637043 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:20.637488 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:20.638206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:20.638666 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:20.639128 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:20.644511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:01:20.651044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:01:20.683630 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:20.807174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-229a6537-4761-4825-a914-06771dfdeba6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.893863 Oct 10 12:01:20.808993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 139/270] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:01:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:01:20.827011 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9f2dfc2c-c480-4427-aea0-24c0a1ee91ea tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:20.828579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9f2dfc2c-c480-4427-aea0-24c0a1ee91ea tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:20.957188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f2dfc2c-c480-4427-aea0-24c0a1ee91ea tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:20.976241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9f2dfc2c-c480-4427-aea0-24c0a1ee91ea tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1241 microversion: 2.1 time: 0.156409 Oct 10 12:01:20.979118 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 140/271] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:20 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:20.986225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:20.987717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:21.012494 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:21.013231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:21.013566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:21.014352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:21.014800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:21.015293 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:21.139161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:21.149949 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c9b696b8-b693-44b1-a265-69ce75e36211 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.534968 Oct 10 12:01:21.150951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 132/272] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:20 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:21.353277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:21.373208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:21.381566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:21.382833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-139bb8b1-b1c6-4e09-ad5b-696cf08ab8b4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.401590 Oct 10 12:01:21.384060 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 141/273] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:20 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:22.003154 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:22.003836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:22.013034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:22.013810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:22.014458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:22.015544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:22.016353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:22.016941 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:22.164325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:22.178436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-93771c70-aa5c-450c-9e17-6337a3d3e9e2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1293 microversion: 2.1 time: 0.179600 Oct 10 12:01:22.178734 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:22.180432 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:22.181474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 133/274] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:21 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:22.209483 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:22.212727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:22.214155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:22.216480 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:22.217281 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:22.218807 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:22.413110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:22.413732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:22.434043 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:22.434560 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:22.435041 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:22.443082 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:22.443568 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:22.444004 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:22.589357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:22.601468 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-64aa3473-27db-4085-bb64-666ccad55899 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.431697 Oct 10 12:01:22.607808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 142/275] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:22 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:22.697666 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:22.706431 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:22.708393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:22.709902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca648416-2c36-4550-9bba-5f1ed53006fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.300971 Oct 10 12:01:22.710468 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 134/276] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:22 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:23.204758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:23.206088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:23.237887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:23.240586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:23.241899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:23.244480 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:23.246366 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:23.247103 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:23.449416 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:23.475045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-68be826f-efbc-4e78-8787-531b299bba15 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1299 microversion: 2.1 time: 0.270026 Oct 10 12:01:23.475703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 143/277] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:23 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:23.631356 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:23.631992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:23.647983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:23.648484 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:23.652731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:23.653812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:23.657302 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:23.657966 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:23.747178 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:23.748306 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:23.764619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:23.765507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:23.768985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:23.772140 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:23.772906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:23.777667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:24.262154 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:24.276517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-52aa85bb-43c3-4f2f-9b04-7d5f6133d17e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.651800 Oct 10 12:01:24.281728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 135/278] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:23 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:24.401612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:24.434145 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:24.435657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:24.436837 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f8c3e9a8-2ac5-460f-a054-82a201ad2325 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.695047 Oct 10 12:01:24.437406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 144/279] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:23 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:24.500038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:24.500686 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:24.534494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:24.544402 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:24.550715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:24.556095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:24.557053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:24.567524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:24.568246 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:25.147315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:25.159146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-502eb998-e0b0-4c2d-b8b6-956eeb2d7ef6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.660553 Oct 10 12:01:25.161625 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 136/280] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:24 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:25.306258 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:25.307492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:25.335317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:25.335830 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:25.342175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:25.343583 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:25.344080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:25.344657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:25.463439 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:25.464055 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:25.475067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:25.475573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:25.477758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:25.485411 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:25.485900 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:25.486341 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:26.050465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:26.072529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0ece554f-80cf-4067-9523-a50d36477cd5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.770778 Oct 10 12:01:26.073136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 145/281] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:25 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:26.074645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:26.090873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ae14819b-528d-4406-9b87-28e71d16d25f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Action: 'create', calling method: .version_select at 0x7f862091bd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1854148940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJFnkjUJPExFVyui0Z8Ffbm16GJueEIPVszqN4yssNv+XpRJAHM4gfdL11TW1An13WYJjsAWOho+6TL2bG+iLgaKF3xJLrpo+b9/3cHkY8Wt/zSyQevTFoMqlvNYPjJiA=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:26.106744 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:26.108263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:26.109478 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-588dd8f1-df9e-4610-9971-15d61be1adf8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.650200 Oct 10 12:01:26.121309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-ae14819b-528d-4406-9b87-28e71d16d25f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Getting quotas for project f2e5245da9a24e679c6e19089e9aa199. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:01:26.132395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-ae14819b-528d-4406-9b87-28e71d16d25f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Getting quotas for user 0b2c9c8c10ec455f85cd95a813692de5 and project f2e5245da9a24e679c6e19089e9aa199. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:01:26.132676 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 137/282] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:25 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:26.183634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:26.185061 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ae14819b-528d-4406-9b87-28e71d16d25f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.110878 Oct 10 12:01:26.185289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:26.188360 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 146/283] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:01:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:26.205426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:26.205546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:26.205943 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:26.207220 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:26.207854 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:26.208462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:26.350496 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1642349625", "imageRef": "56747bfe-2af9-4eb1-88c9-46d59c474658", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1854148940", "networks": [{"uuid": "403653f0-e953-43e2-82d0-5e0a7bd2c4a5"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:26.441160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] validate_networks() for [('403653f0-e953-43e2-82d0-5e0a7bd2c4a5', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:01:26.499206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:26.511357 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-05825c81-f762-4e68-909b-ca28283295e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.331234 Oct 10 12:01:26.513143 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 138/284] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:26 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:27.106320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:27.107098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:27.119576 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.120355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.120804 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.121522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.121986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.131153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.464293 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:27.465745 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:01:27.466703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:01:27.467422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:01:27.468045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:01:27.468667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:01:27.474937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dc9786af-4d99-4048-ac35-e308ba412cad tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.377678 Oct 10 12:01:27.475673 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 139/285] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:27 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:27.481353 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.481936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.482280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:27.482633 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.483360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:27.483674 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.484211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.484764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.491062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.491848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.492522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.493670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.494442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.495198 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.510910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Getting quotas for project f2e5245da9a24e679c6e19089e9aa199. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:01:27.516007 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Getting quotas for user 0b2c9c8c10ec455f85cd95a813692de5 and project f2e5245da9a24e679c6e19089e9aa199. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:01:27.529458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:01:27.535873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56747bfe-2af9-4eb1-88c9-46d59c474658',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:01:27.613363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f65527d3-6563-4fae-8316-7ff89853fa8c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266496 Oct 10 12:01:27.620791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 147/286] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:01:27.626839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7180e11d-b5ac-43d3-b687-fe31a85df175 req-22943fdc-ebe7-463f-a24e-c1a7d43edd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a6a752b-46c1-419a-a67f-b438ec73dfef", "tag": "8f41ae8d-ac23-4143-85d3-27cb22c3af90"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:27.652558 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7180e11d-b5ac-43d3-b687-fe31a85df175 req-22943fdc-ebe7-463f-a24e-c1a7d43edd81 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.653037 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7180e11d-b5ac-43d3-b687-fe31a85df175 req-22943fdc-ebe7-463f-a24e-c1a7d43edd81 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.653461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7180e11d-b5ac-43d3-b687-fe31a85df175 req-22943fdc-ebe7-463f-a24e-c1a7d43edd81 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.684344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7180e11d-b5ac-43d3-b687-fe31a85df175 req-22943fdc-ebe7-463f-a24e-c1a7d43edd81 service nova] Creating event network-changed:8f41ae8d-ac23-4143-85d3-27cb22c3af90 for instance 0a6a752b-46c1-419a-a67f-b438ec73dfef on hv-cinder-85061 Oct 10 12:01:27.697862 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7180e11d-b5ac-43d3-b687-fe31a85df175 req-22943fdc-ebe7-463f-a24e-c1a7d43edd81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073087 Oct 10 12:01:27.699530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 148/287] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:27.724968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:27.734409 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:27.743013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:27.755030 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:27.756928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:27.758864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a2ea320d-8d7e-40f4-80da-3d6f227246b8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.281343 Oct 10 12:01:27.759976 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 140/288] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:27 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:27.765855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-97c2c0e0-0b5d-4559-9a67-51c3b913fb6b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:27.766656 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-97c2c0e0-0b5d-4559-9a67-51c3b913fb6b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:27.781196 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.782845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.783798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.785203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:27.786021 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:27.786627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:27.846707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:27.859084 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-97c2c0e0-0b5d-4559-9a67-51c3b913fb6b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:27.874582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-97c2c0e0-0b5d-4559-9a67-51c3b913fb6b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1259 microversion: 2.1 time: 0.113234 Oct 10 12:01:27.878455 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 141/289] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:27 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1259 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:27.996974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:28.019273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e9a0c5c6-ea0f-4dd3-8f49-c3c1d58c753f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.313710 Oct 10 12:01:28.020174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 149/290] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:27 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:28.500177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:28.500805 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:28.507303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:28.508181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:28.508894 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:28.509829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:28.510504 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:28.511196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:28.772413 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:28.790448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:28.792560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:28.799660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d10fb1a0-d799-4990-9467-1088ba95ef80 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.286392 Oct 10 12:01:28.800344 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 142/291] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:28 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:28.804020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:28.807050 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:28.807724 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:28.808447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:28.808908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:28.809335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:28.903937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:28.904623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:28.919815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:28.920393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:28.920897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:28.921680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:28.922145 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:28.925078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:29.072525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:29.091222 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-abaca555-be94-4b90-bf24-f2aa5599d207 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1263 microversion: 2.1 time: 0.192067 Oct 10 12:01:29.093122 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 143/292] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:28 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:29.099668 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:29.100529 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:29.111113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:29.111815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:29.112472 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:29.113382 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:29.114091 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:29.115796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:29.182806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:29.203155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:29.211788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:29.216784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-402cfb74-59f8-4e77-91f5-4215a33f6fa1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.430150 Oct 10 12:01:29.218529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 150/293] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:28 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:29.553347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:29.565241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-95080b26-e1d6-43de-925d-b9ad3ecbbab7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.470405 Oct 10 12:01:29.565834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 144/294] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:29 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:29.824849 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:29.825462 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:29.831914 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:29.832405 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:29.832841 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:29.833527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:29.833982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:29.834402 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.115867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:30.116499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:30.139491 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.140002 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.140443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.141161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.141624 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.142054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.321761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:30.330245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-542db95a-cbc5-45df-9b18-a57202b3e346 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.509615 Oct 10 12:01:30.332053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 151/295] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:29 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:30.337315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:30.338116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:30.345251 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.346147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.346733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.347743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.348362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.348945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.419422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:30.433735 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-54070210-4bd9-4df4-bfe3-df8d2706a363 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1311 microversion: 2.1 time: 0.322482 Oct 10 12:01:30.449769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 145/296] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:30 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:30.466801 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-54dddfbd-271d-43b6-891f-3cfd94e51f2d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:30.473029 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54dddfbd-271d-43b6-891f-3cfd94e51f2d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.474264 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54dddfbd-271d-43b6-891f-3cfd94e51f2d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.474861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-54dddfbd-271d-43b6-891f-3cfd94e51f2d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.573774 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-54dddfbd-271d-43b6-891f-3cfd94e51f2d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Going to try to stop instance {{(pid=120662) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 12:01:30.646120 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-54dddfbd-271d-43b6-891f-3cfd94e51f2d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action" status: 202 len: 0 microversion: 2.1 time: 0.194858 Oct 10 12:01:30.648076 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 146/297] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:01:30 2022] POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:01:30.666678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:30.668519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:30.687300 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.687811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.691626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.692559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.693243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.694530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.715308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:30.749648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:30.752436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:30.753978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-39a48448-5a6b-4e6d-9797-5fef694788b1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1744 microversion: 2.20 time: 0.420315 Oct 10 12:01:30.762974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 152/298] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:30 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1744 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:30.770351 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:30.771008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:30.782240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.782988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.783586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:30.785195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:30.785820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:30.786404 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:31.259088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:31.275506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f701cb95-0fd8-462c-ab0e-48889e573e55 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.625876 Oct 10 12:01:31.277178 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 147/299] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:30 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:31.358529 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:31.359565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:31.365598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:31.377944 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5285ef99-6e84-4b13-905b-ee52f6ee5be5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.613172 Oct 10 12:01:31.379480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:31.380279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 153/300] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:30 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:31.381632 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:31.382258 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:31.384165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:31.385389 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:31.385971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:31.460566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:31.461979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:31.468233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:31.472525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:31.475068 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:31.475801 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:31.476282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:31.476818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:31.490844 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:31.635718 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:31.651151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8efa44ea-0b93-4c13-aef0-fea6fc7e3a65 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1311 microversion: 2.1 time: 0.193407 Oct 10 12:01:31.653314 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 154/301] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:31 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1311 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:31.780678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:31.781296 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:31.794147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:31.794647 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:31.795137 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:31.795849 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:31.796307 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:31.796739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:31.912772 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:31.926621 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6c0e5529-a0e0-4a90-8b46-f91ff6e4ab2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.573724 Oct 10 12:01:31.927554 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 148/302] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:31 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:32.253870 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:32.264681 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:32.266645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:32.269998 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1018276f-5933-4c85-b9cc-5705af9b8b79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1744 microversion: 2.20 time: 0.492711 Oct 10 12:01:32.271526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 155/303] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:31 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1744 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:32.305988 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:32.306845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:32.313642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:32.314340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:32.315290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:32.316175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:32.316801 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:32.317473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:32.339322 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:32.404039 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:32.404655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:32.429058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:32.431709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:32.433188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:32.435222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:32.436812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:32.437610 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:32.945188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:32.956423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6f4ce0ae-7e9c-49b2-be43-9a55f863be50 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.658015 Oct 10 12:01:32.957365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 149/304] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:32 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:32.965589 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:32.966696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:32.975606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:32.977604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:32.978053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:32.978772 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:32.980507 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:32.981019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:33.157230 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:33.158840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:33.174610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-26f636c5-ac10-45fd-b47e-74bc119e7674 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1317 microversion: 2.1 time: 0.215108 Oct 10 12:01:33.178319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 150/305] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:32 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:33.182525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2b50dbc4-7d81-44eb-8e02-767f0da68235 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.782252 Oct 10 12:01:33.183157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 156/306] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:32 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:33.202822 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:33.208597 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:33.220243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:33.224144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:33.224714 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:33.242947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:33.247528 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:33.248112 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:33.300708 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:33.301647 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:33.320458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:33.322148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:33.322608 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:33.324353 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:33.324828 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:33.325265 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:33.622033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:33.639656 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c3897b34-deb5-4067-9ab5-d15bcbdeada5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.459617 Oct 10 12:01:33.640548 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 151/307] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:33 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:33.806395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:33.816512 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:33.818287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:33.819122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2f3aa9a8-d5c2-43f8-a4e3-b6133864e30f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.524302 Oct 10 12:01:33.831388 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 157/308] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:33 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:33.981177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:33.985986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:33.997335 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:34.000594 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:34.001144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:34.001989 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:34.004955 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:34.005524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:34.207727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:34.208796 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:34.215930 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:34.216704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:34.217293 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:34.218447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:34.219253 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:34.220129 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:34.501401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:34.509665 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e2a6f46d-a811-4c3c-beb5-d97c9ce9308b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1317 microversion: 2.1 time: 0.307776 Oct 10 12:01:34.511356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 158/309] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:34 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:34.516823 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:34.518080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:34.524651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:34.525264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:34.525836 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:34.526626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:34.528639 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:34.529069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:34.942963 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:34.966365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-babf15f1-6976-4176-97ed-4a1a2a01c821 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.988879 Oct 10 12:01:34.967918 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 152/310] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:33 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:34.983676 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:34.985321 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:35.001372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:35.003276 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:35.005361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:35.007343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:35.008875 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:35.013646 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:35.108699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:35.117827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-673cb982-b410-4bc6-9cf9-10840ad7b6f6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.604520 Oct 10 12:01:35.138815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 159/311] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:34 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:35.153100 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c2d0066b-1b29-4871-87a5-bc807b99f27d req-27c1d99c-e2e3-4456-bf66-77f7737b72bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc3237-f592-4db7-9f6a-294f4cea3c9a", "name": "network-vif-plugged", "status": "completed", "tag": "fa2ac855-9b1f-4330-96cc-cad641c595d3"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:35.179139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c2d0066b-1b29-4871-87a5-bc807b99f27d req-27c1d99c-e2e3-4456-bf66-77f7737b72bb service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:35.185881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c2d0066b-1b29-4871-87a5-bc807b99f27d req-27c1d99c-e2e3-4456-bf66-77f7737b72bb service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:35.186587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c2d0066b-1b29-4871-87a5-bc807b99f27d req-27c1d99c-e2e3-4456-bf66-77f7737b72bb service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:35.219045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c2d0066b-1b29-4871-87a5-bc807b99f27d req-27c1d99c-e2e3-4456-bf66-77f7737b72bb service nova] Creating event network-vif-plugged:fa2ac855-9b1f-4330-96cc-cad641c595d3 for instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a on hv-cinder-85061 Oct 10 12:01:35.225017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c2d0066b-1b29-4871-87a5-bc807b99f27d req-27c1d99c-e2e3-4456-bf66-77f7737b72bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075402 Oct 10 12:01:35.227393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 160/312] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:35.239251 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:35.240304 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:35.252859 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:35.253467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:35.254269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:35.254878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:35.255705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:35.256141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:35.626598 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:35.636159 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4ed5f1e9-54c4-45a2-905a-85e75c46714a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.666747 Oct 10 12:01:35.637658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 153/313] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:34 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:35.642748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:35.643648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:35.651181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:35.651976 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:35.653185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:35.654105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:35.654769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:35.655459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:35.938420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:35.980396 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:35.987759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:35.989762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fa5e6477-2b66-4df1-8ba7-80c212adf776 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.757785 Oct 10 12:01:36.017160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 161/314] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:35 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:36.042353 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:36.044023 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:36.046762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:36.063344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:36.064194 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:36.064778 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:36.065906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:36.066707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:36.067370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:36.453187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:36.467655 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c213b29f-eed7-40f3-81bb-33a601be1c84 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.828368 Oct 10 12:01:36.470571 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 154/315] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:35 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:36.479148 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:36.480174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:36.487850 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:36.488741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:36.489456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:36.490370 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:36.491012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:36.491590 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:36.729847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:36.746986 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-885ab710-7162-44bc-9527-82c0055b74b6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.726771 Oct 10 12:01:36.748209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 162/316] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:36 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:36.754629 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:36.755518 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:36.770068 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:36.770979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:36.771862 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:36.772768 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:36.774009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:36.774749 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:36.917377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:36.927505 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-58f81879-8998-4892-84d1-f3b2abbf64eb tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.454685 Oct 10 12:01:36.928599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 155/317] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:36 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:37.028472 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:37.029245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:37.044369 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:37.046733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:37.051037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:37.055184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:37.055868 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:37.056328 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:37.258505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:37.267298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e9991b0-a41f-44cf-9d22-4ae6662fc81b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.517826 Oct 10 12:01:37.273691 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 163/318] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:36 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:37.448287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:37.458972 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:37.462134 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:37.468125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1c8e8af0-a8a1-4b41-b204-26dc5fb68379 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.443742 Oct 10 12:01:37.477946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 156/319] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:37 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:37.501304 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:37.501304 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:37.502868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:37.513758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:37.514260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:37.514695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:37.519171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:37.520284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:37.521902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:37.530474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=18 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:37.863498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:37.880483 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:37.896244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8a5efa6b-8c4a-407e-9332-641652b182d5 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.398472 Oct 10 12:01:37.897433 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 164/320] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:37 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:37.925713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:37.927508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:37.947523 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:37.948038 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:37.949505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:37.951932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:37.952402 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:37.954602 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:38.332525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:38.344628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3bb79598-e118-4798-a407-451609db5b17 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.437952 Oct 10 12:01:38.347203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 165/321] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:37 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:38.355234 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:38.358355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:38.373183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:38.373823 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:38.374527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:38.376433 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:38.377139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:38.378620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:38.567286 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c9bb6d30-9ba3-4f97-968c-2e7900f2326a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Action: 'create', calling method: .version_select at 0x7f86207438b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-535509752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsff2tnjzOwDgwPNSz1+XThWN7EXa9ikt4d186EXzqqt1+Bo/9yv4w+Jq1wsC+19Nzyuph5TH0dcThxun6xyU+cgSGDTLpj4FvZb1f22IxJ2oMMFltXLxxaN4XQgza27Q=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:38.601148 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c9bb6d30-9ba3-4f97-968c-2e7900f2326a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:01:38.614471 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c9bb6d30-9ba3-4f97-968c-2e7900f2326a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for user ce6a1b5ca7584f90bfe83b73aff1335a and project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:01:38.675841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c9bb6d30-9ba3-4f97-968c-2e7900f2326a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.910809 Oct 10 12:01:38.680211 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 157/322] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:01:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:38.683853 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:38.699045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ee49fed6-ce01-4d8c-95fd-56fc9148520f tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.350417 Oct 10 12:01:38.699743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 166/323] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:38 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:38.716971 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:38.719640 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:38.728528 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:38.731189 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:38.735239 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:38.749197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:38.749649 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:38.750510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:38.750997 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:38.751425 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:38.768058 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:38.769782 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:38.772137 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:38.776050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:38.777222 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:38.780070 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:39.368813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:39.379410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2d333e7a-0d2f-4bc3-9060-b2d23dace67d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1501 microversion: 2.1 time: 0.697415 Oct 10 12:01:39.380184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 158/324] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:38 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1501 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:39.385164 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:39.402549 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:39.408557 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:39.412107 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:39.412695 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:39.415790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:39.416499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:39.417358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:39.755951 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:39.780993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:39.785229 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:39.791160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11383947-98a3-4167-adcd-57f9ae888c4b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 1.080751 Oct 10 12:01:39.792109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 167/325] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:38 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:39.799107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-b791ac1b-a9c4-47ae-9303-cb1d48244713 req-ecf40533-7622-4108-8a0c-898ca0d22d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6a752b-46c1-419a-a67f-b438ec73dfef", "name": "network-vif-plugged", "status": "completed", "tag": "8f41ae8d-ac23-4143-85d3-27cb22c3af90"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:39.843095 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b791ac1b-a9c4-47ae-9303-cb1d48244713 req-ecf40533-7622-4108-8a0c-898ca0d22d39 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:39.844731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b791ac1b-a9c4-47ae-9303-cb1d48244713 req-ecf40533-7622-4108-8a0c-898ca0d22d39 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:39.846777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-b791ac1b-a9c4-47ae-9303-cb1d48244713 req-ecf40533-7622-4108-8a0c-898ca0d22d39 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:39.891243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-b791ac1b-a9c4-47ae-9303-cb1d48244713 req-ecf40533-7622-4108-8a0c-898ca0d22d39 service nova] Creating event network-vif-plugged:8f41ae8d-ac23-4143-85d3-27cb22c3af90 for instance 0a6a752b-46c1-419a-a67f-b438ec73dfef on hv-cinder-85061 Oct 10 12:01:39.896945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-b791ac1b-a9c4-47ae-9303-cb1d48244713 req-ecf40533-7622-4108-8a0c-898ca0d22d39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103346 Oct 10 12:01:39.915534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 168/326] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:39.934861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:39.935729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:39.945948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:39.946442 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:39.946883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:39.947603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:39.948052 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:39.948468 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.008236 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:40.036865 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f22c4175-ed0e-4571-ac1a-3bfb8d36be97 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.655262 Oct 10 12:01:40.037701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 159/327] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:39 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:40.076472 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75257132-b7c0-415e-bf6b-80480d1fc2d2"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:40.083241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:40.104591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.105177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.105604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.106276 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.112235 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.112725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.173386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] HTTP exception thrown: Cannot 'attach_volume' instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 while it is in vm_state rescued Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Request method failure captured: Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49/os-volume_attachments HTTP/1.1 Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 74 Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkc6ANJAn4uWtl_9BYI0POST6SAJGl-9w8hepgSBg41ul6fod8KOQddqQkxt1Uw-ZG8vRij_xsT-LzUklmeqbM4dSCd-LTGn5cNdEAEWq0Ox0m4Yc5Ojo99W3zjXXSDMI_atXaQKn5Q67dJ5BUtLcftGHaFeozYhYayoWEXU009_tI Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:01:40.179051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b72dcfa7755e499f8f55ade0fde3d7c7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}] Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 99b3e727e6fa480c90a054a60b68b8d0 Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {"volumeAttachment": {"volumeId": "75257132-b7c0-415e-bf6b-80480d1fc2d2"}} Oct 10 12:01:40.180920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Cannot 'attach_volume' instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 while it is in vm_state rescued Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '0079dd21-134c-4eba-b98a-5e223f5bfb49', 'body': {'volumeAttachment': {'volumeId': '75257132-b7c0-415e-bf6b-80480d1fc2d2'}}} Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:40.181983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 while it is in vm_state rescued Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:40.183452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:40.184684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:40.184684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:40.184684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 while it is in vm_state rescued Oct 10 12:01:40.184684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:01:40.186372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Returning 409 to user: Cannot 'attach_volume' instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 while it is in vm_state rescued {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:40.187305 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4409c935-24ad-4728-b7ca-3f04709065bb tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.122730 Oct 10 12:01:40.187889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 160/328] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:01:40 2022] POST /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49/os-volume_attachments => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 12:01:40.192810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:40.193797 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:40.202486 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.209900 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.210476 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.218281 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.221177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.229714 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.519900 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:40.543382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6dc974e4-bc89-43eb-b0ed-9cfa5c4b5e6b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.626456 Oct 10 12:01:40.556116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 169/329] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:39 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:40.569276 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:40.572264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:40.597679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.599341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.599976 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.600904 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.601719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.602762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.752049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c896269-72f3-4d24-910b-7bb85020b91e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49/action" status: 202 len: 0 microversion: 2.1 time: 0.193668 Oct 10 12:01:40.758201 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 170/330] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:01:40 2022] POST /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:01:40.772023 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:40.773119 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:40.781110 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.781958 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.782648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.783778 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.784639 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.785300 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.790633 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:40.865395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:40.875510 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a9a3a227-65c4-4a63-8c50-2ba0adc0f3b8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.686520 Oct 10 12:01:40.876043 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 161/331] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:40 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:40.887516 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:40.892886 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:40.910720 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.911601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.912406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:40.913371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:40.914083 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:40.914727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:41.570491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:41.575020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:41.582841 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bb58e7ea-1f53-4799-83d4-8352e1e2270d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1509 microversion: 2.1 time: 0.818071 Oct 10 12:01:41.589856 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:41.590855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 171/332] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:40 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1509 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:41.591338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:41.592521 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-77b90fb9-71fa-4c29-a269-75357ecf5287 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.709432 Oct 10 12:01:41.609091 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:41.609579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:41.615001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 162/333] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:40 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:41.632111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:41.632795 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:41.646447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:41.646969 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:41.647406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:41.648989 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:41.649492 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:41.649934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:41.650645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:41.651152 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:41.651375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:41.651581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:41.652179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:41.652763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:42.372021 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:42.387203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c972d23b-82fa-401b-aba4-a59fc7205694 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.794499 Oct 10 12:01:42.397305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 172/334] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:41 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:42.428620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:42.430014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:42.463957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:42.465877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:42.466637 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:42.468080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:42.472524 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:42.473510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:43.061609 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:43.073818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-07ad6514-90e3-44d3-bbdc-92dfa143ed89 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 1.455456 Oct 10 12:01:43.088416 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 163/335] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:41 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:43.100283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:43.100914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:43.118859 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:43.119423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:43.121990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:43.123011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:43.123632 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:43.124269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:43.146760 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:43.171481 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eedcd9c7-2071-43c4-a5ef-9c8ced0024de tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.771443 Oct 10 12:01:43.173439 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 173/336] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:42 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:43.180309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:43.181260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:43.203940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:43.204414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:43.204846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:43.205554 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:43.206013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:43.206443 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:44.318225 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:44.334669 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-43780cf4-063c-4f43-b683-8d25ef91b637 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1509 microversion: 2.1 time: 1.244566 Oct 10 12:01:44.339432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 164/337] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:43 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1509 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:44.357855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-bf838b59-0af1-49ff-9429-af1122acf0dc req-393bbbeb-bbdd-4325-8d54-8ecd2788801f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfd5ad5-1c5f-46b8-9db7-189214d74a56", "tag": "8350774c-a156-46d0-bb3c-69064aad8304"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:44.390375 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bf838b59-0af1-49ff-9429-af1122acf0dc req-393bbbeb-bbdd-4325-8d54-8ecd2788801f service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:44.394744 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bf838b59-0af1-49ff-9429-af1122acf0dc req-393bbbeb-bbdd-4325-8d54-8ecd2788801f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:44.395583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bf838b59-0af1-49ff-9429-af1122acf0dc req-393bbbeb-bbdd-4325-8d54-8ecd2788801f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:44.447962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-bf838b59-0af1-49ff-9429-af1122acf0dc req-393bbbeb-bbdd-4325-8d54-8ecd2788801f service nova] Creating event network-changed:8350774c-a156-46d0-bb3c-69064aad8304 for instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 on hv-cinder-85061 Oct 10 12:01:44.461772 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-bf838b59-0af1-49ff-9429-af1122acf0dc req-393bbbeb-bbdd-4325-8d54-8ecd2788801f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120202 Oct 10 12:01:44.467500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 165/338] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:44.476021 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:44.481499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:44.489663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:44.502954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:44.503707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:44.504384 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:44.505323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:44.505992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:44.506654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:44.517777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:44.519559 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:44.520940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9d136b03-81ab-4bc3-8720-b8010734747c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 1.346287 Oct 10 12:01:44.524042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 174/339] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:43 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:44.535538 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:44.539350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:44.557525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:44.558256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:44.558852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:44.559762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:44.560372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:44.560979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:44.939707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:44.955300 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-922c53c5-4585-4a60-8a83-5d08861fee1f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.485439 Oct 10 12:01:44.956281 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 166/340] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:44 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:44.977886 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:44.978771 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:44.985557 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:44.986309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:44.986971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:44.988040 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:44.988691 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:44.989323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:45.011016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:45.025404 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9f5695a6-71bd-4dd4-9c88-dfe0cf459b30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.494048 Oct 10 12:01:45.026429 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 175/341] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:44 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:45.367250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:45.368327 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:45.392694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:45.393945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:45.394810 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:45.399138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:45.401928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:45.402374 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:45.442706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:45.445912 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:45.455594 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-042550d8-8ae9-4348-9be5-1b6cc156e5f1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.497983 Oct 10 12:01:45.462006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 167/342] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:44 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:45.556066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:45.557059 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:45.563880 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:45.564791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:45.565406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:45.566280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:45.566914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:45.567499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:45.732925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:45.743154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fba99dd8-7474-4075-bf9a-d8dc6e49fe37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1509 microversion: 2.1 time: 0.380680 Oct 10 12:01:45.744291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 176/343] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:45 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:45.776028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:45.786057 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:45.788446 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:45.790216 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cee132c1-d054-4957-8976-b018c3821b2e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.239700 Oct 10 12:01:45.791423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 168/344] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:45 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:45.981737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:45.982348 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:45.994260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:45.995557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:45.996390 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:45.997109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:45.997564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:45.998689 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.050440 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:46.051097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:46.058412 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.059036 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.059538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.060441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.060904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.061392 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.229815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:46.243528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cb7ab89c-bdee-4508-832a-15ab3e803721 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.264305 Oct 10 12:01:46.244475 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 177/345] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:45 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:46.287768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:46.314699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-50d78202-8c97-4c65-8bfb-54730cb68d68 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.268012 Oct 10 12:01:46.315800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 169/346] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:46 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:46.494556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:46.495112 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:46.502214 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.502709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.503370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.504227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.504839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.505415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.722116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:46.732777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5c7677f-df29-476b-bf90-c2f82e84f91e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.248783 Oct 10 12:01:46.738228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 178/347] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:46 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:46.774611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:46.775396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:46.793718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.794496 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.795063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.795914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.796607 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.797133 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.817063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:46.822969 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:46.869266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.869709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.879225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:46.883160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:46.883885 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:46.884490 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:47.264462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:47.273013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-22fcc7b4-13cd-49f4-8f87-5e4096b2041f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1509 microversion: 2.1 time: 0.503104 Oct 10 12:01:47.274098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 170/348] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:46 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:01:47.284156 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:47.287943 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:47.301319 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:47.301870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:47.302975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:47.304080 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:47.304981 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:47.305592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:47.306168 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:47.315569 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:47.316998 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:47.319020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7140363e-42c9-4892-861e-174ae9952ad3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.506399 Oct 10 12:01:47.340108 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 179/349] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:46 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:47.357046 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:47.360531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:47.380939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:47.381439 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:47.381882 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:47.383184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:47.383652 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:47.386436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:47.543754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:47.556462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0842c489-735b-4b14-a20d-feb41041ee72 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.277701 Oct 10 12:01:47.557693 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 171/350] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:47 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:47.639411 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:47.648590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3eb95447-d4c1-4a8a-bd51-44951131cba0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1367 microversion: 2.1 time: 0.306521 Oct 10 12:01:47.650846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 180/351] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:47 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:47.766909 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:47.767535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:47.774638 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:47.775324 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:47.775660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:47.776371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:47.776830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:47.777257 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:47.932358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:47.941720 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-84eb7c84-1695-47b6-b990-a842459aaaa3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1723 microversion: 2.1 time: 0.179884 Oct 10 12:01:47.942307 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 172/352] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:47 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:48.302941 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:48.304727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:48.320962 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.321614 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.322385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:48.323379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.324498 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.339301 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:48.347449 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:48.348170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:48.374840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.381288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.381756 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:48.393054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.394254 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.394906 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:48.629312 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:48.706268 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:48.709234 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:48.719001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1297a88c-a108-463f-91cb-dec40cfef560 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1509 microversion: 2.1 time: 0.421187 Oct 10 12:01:48.727034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:48.729258 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:48.730641 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-935978d1-4d90-493d-af1f-e1e65c687378 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.389010 Oct 10 12:01:48.736018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 181/353] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:48 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:48.741090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:48.744080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:48.751566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.752435 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.753121 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:48.754064 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.755408 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.755524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 173/354] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:48 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:01:48.756411 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:48.762186 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:48.763247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:48.771603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.772345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.776825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:48.779626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:48.780812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:48.782062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.152001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:49.162946 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-adffb7c6-4cfc-4250-af6e-549a0c0eec83 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.425435 Oct 10 12:01:49.168705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:49.170185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 182/355] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:48 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:49.183178 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:49.184270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:49.196975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9bd7bd57-a966-4b8e-adf5-c1c1ab09d9fa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1556 microversion: 2.1 time: 0.440285 Oct 10 12:01:49.199621 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.200177 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.200641 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.201395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.201854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.202283 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.211562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 174/356] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:48 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1556 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:49.226733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:49.227482 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:49.234344 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.234974 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.235493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.236353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.236887 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.237507 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.448648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6509972f-d1c7-4b65-b109-ff3cfba99266 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231195 Oct 10 12:01:49.449424 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 175/357] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 12:01:49 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:49.510534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:49.523821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-30f32651-9aa0-434d-8bdb-26628b8436b4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1700 microversion: 2.1 time: 0.352287 Oct 10 12:01:49.529173 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 183/358] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:49 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1700 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:49.556602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8009f70a-2881-4994-8efe-2309efd2fd29 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:49.571208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8009f70a-2881-4994-8efe-2309efd2fd29 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.571812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8009f70a-2881-4994-8efe-2309efd2fd29 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.572345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8009f70a-2881-4994-8efe-2309efd2fd29 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.632390 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8009f70a-2881-4994-8efe-2309efd2fd29 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Going to try to start instance {{(pid=120662) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 12:01:49.744170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:49.745664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:49.757756 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.760017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.761526 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8009f70a-2881-4994-8efe-2309efd2fd29 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action" status: 202 len: 0 microversion: 2.1 time: 0.209472 Oct 10 12:01:49.761794 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.762737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.765189 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 176/359] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:01:49 2022] POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:01:49.767247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.767922 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.777457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:49.778946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:49.800585 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.802906 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.803616 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:49.807818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:49.808382 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:49.812458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:50.264089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:50.272446 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:50.280866 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:50.282262 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-20a2bef0-92d5-4877-af18-53c64bd49f21 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.515711 Oct 10 12:01:50.295466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 177/360] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:49 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:50.314707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:50.316967 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:50.330687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:50.333506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:50.334044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:50.334879 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:50.337620 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:50.338181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:50.455347 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:50.463989 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4d105094-5bff-4be9-90b4-19a79a7e5d62 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1509 microversion: 2.1 time: 0.724435 Oct 10 12:01:50.468210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 184/361] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:49 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1509 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:50.479220 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:50.492052 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:50.499910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:50.500723 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:50.501400 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:50.502203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:50.503214 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:50.504043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:50.861726 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:50.874592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-341e0baf-a599-40cd-9103-d504cb651058 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1709 microversion: 2.1 time: 0.575911 Oct 10 12:01:50.886919 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 178/362] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:50 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1709 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:50.918458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:50.934410 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-199dd660-4cba-4c1b-8247-0d8c7a43047f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.464787 Oct 10 12:01:50.935605 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 185/363] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:50 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:51.312610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:51.313277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:51.321444 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:51.322338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:51.322858 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:51.323758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:51.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:51.324993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:51.496048 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:51.497336 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:51.506933 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:51.510069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:51.510699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:51.511641 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:51.512325 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:51.515127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:52.081631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:52.091882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:52.092285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:52.099642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:52.101631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-280a013a-787b-4a9e-9021-b70829205648 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.793279 Oct 10 12:01:52.102793 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 179/364] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:51 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:52.103522 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-92185853-4418-412f-8f3a-c7d0d78461ba tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1509 microversion: 2.1 time: 0.614374 Oct 10 12:01:52.119062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 186/365] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:51 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1509 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:52.119062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:52.119062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:52.127340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:52.127955 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:52.128447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:52.128874 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:52.129396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:52.133957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:52.134526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:52.135019 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:52.136067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:52.137710 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:52.138435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:52.139174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:52.140043 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:52.140831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:52.141426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:52.585028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:52.605140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-edc78766-1af9-44e0-96ba-31dd897ea310 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1709 microversion: 2.1 time: 0.496104 Oct 10 12:01:52.606116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 180/366] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:52 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1709 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:52.621315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-87616c20-17db-411a-8797-42bccc4aaab7 req-49f5d3d5-4af9-40e1-a4d3-208f8bc92db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a6a752b-46c1-419a-a67f-b438ec73dfef", "tag": "8f41ae8d-ac23-4143-85d3-27cb22c3af90"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:52.655502 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-87616c20-17db-411a-8797-42bccc4aaab7 req-49f5d3d5-4af9-40e1-a4d3-208f8bc92db1 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:52.656951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-87616c20-17db-411a-8797-42bccc4aaab7 req-49f5d3d5-4af9-40e1-a4d3-208f8bc92db1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:52.657716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-87616c20-17db-411a-8797-42bccc4aaab7 req-49f5d3d5-4af9-40e1-a4d3-208f8bc92db1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:52.671443 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:52.678227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:52.692887 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-87616c20-17db-411a-8797-42bccc4aaab7 req-49f5d3d5-4af9-40e1-a4d3-208f8bc92db1 service nova] Creating event network-changed:8f41ae8d-ac23-4143-85d3-27cb22c3af90 for instance 0a6a752b-46c1-419a-a67f-b438ec73dfef on hv-cinder-85061 Oct 10 12:01:52.693989 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-370cb133-3a9e-412a-b212-75fc7aad2e7b tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.582714 Oct 10 12:01:52.700990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-87616c20-17db-411a-8797-42bccc4aaab7 req-49f5d3d5-4af9-40e1-a4d3-208f8bc92db1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092798 Oct 10 12:01:52.702013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 181/367] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:52.707103 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 187/368] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:52 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:53.138513 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:53.139283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:53.140189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:53.140908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:53.160615 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:53.161163 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:53.161916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:53.162549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:53.163245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:53.164721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:53.165320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:53.166214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:53.168209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:53.168846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:53.169530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:53.174401 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:53.688593 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:53.705410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:53.706907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:53.708505 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b86bda9-b299-447a-9168-3354f42603b9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.579726 Oct 10 12:01:53.723122 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 182/369] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:53 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:53.749931 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-e0c5cd0b-a6a3-4968-89b5-29877abc6399 req-f107b6b4-28d7-4a75-85a8-cc61aad98f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfd5ad5-1c5f-46b8-9db7-189214d74a56", "name": "network-vif-plugged", "status": "completed", "tag": "8350774c-a156-46d0-bb3c-69064aad8304"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:53.777415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e0c5cd0b-a6a3-4968-89b5-29877abc6399 req-f107b6b4-28d7-4a75-85a8-cc61aad98f6b service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:53.777900 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e0c5cd0b-a6a3-4968-89b5-29877abc6399 req-f107b6b4-28d7-4a75-85a8-cc61aad98f6b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:53.778331 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e0c5cd0b-a6a3-4968-89b5-29877abc6399 req-f107b6b4-28d7-4a75-85a8-cc61aad98f6b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:53.815849 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-e0c5cd0b-a6a3-4968-89b5-29877abc6399 req-f107b6b4-28d7-4a75-85a8-cc61aad98f6b service nova] Creating event network-vif-plugged:8350774c-a156-46d0-bb3c-69064aad8304 for instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 on hv-cinder-85061 Oct 10 12:01:53.822489 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-e0c5cd0b-a6a3-4968-89b5-29877abc6399 req-f107b6b4-28d7-4a75-85a8-cc61aad98f6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097244 Oct 10 12:01:53.823485 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 183/370] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:53.834717 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:53.835758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:53.843957 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:53.844762 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:53.845415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:53.846295 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:53.847002 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:53.848047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:54.441947 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:54.453520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bfaaf7fb-7b62-411d-ae37-7321ffa073fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1515 microversion: 2.1 time: 1.322311 Oct 10 12:01:54.484925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 188/371] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:53 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1515 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:54.515313 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:54.518173 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:54.534584 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:54.535290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:54.537837 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:54.539586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:54.541497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:54.543936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:54.566035 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:54.575997 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bcfbbbd9-194e-42e5-a588-99609de7c037 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1709 microversion: 2.1 time: 0.751180 Oct 10 12:01:54.576749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 184/372] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:53 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1709 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:54.740863 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:54.741908 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:54.755703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:54.758032 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:54.767778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:54.768910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:54.769603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:54.770264 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:54.782029 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:55.130025 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:55.146655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd342c15-f296-45da-a7d8-8da2ab11a95e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1359 microversion: 2.1 time: 0.657144 Oct 10 12:01:55.150141 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 189/373] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:54 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1359 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:55.331452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:55.341430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:55.351648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:55.355351 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-963f625a-0d08-47d2-bafc-fff232f76a7f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.618099 Oct 10 12:01:55.370936 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 185/374] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:54 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:55.608376 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:55.610208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:55.618447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:55.619210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:55.619965 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:55.621328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:55.622218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:55.622877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:55.808755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:55.825302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-08a4e0ef-45a8-4ffe-af29-3c323c64df49 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1709 microversion: 2.1 time: 0.224850 Oct 10 12:01:55.826144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 190/375] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:55 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1709 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:56.178848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:56.180355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:56.189933 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.190980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.191654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.192758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.193436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.194077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.216208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f1e88298-3fea-41c2-b3d4-4ccf771ea748 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'create', calling method: .version_select at 0x7f8620783ca0>, body: {"keypair": {"name": "tempest-keypair-1086426870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7Ohq+rEb8w5TtSFHrqh0boANXziielRkTK3GIk54Keh9ARLEylglsWcAJgUAzM4Hc1vKS5GqFx3yGO1v5I8jMpCgXALEcxG3ZKQYZoNXCKLhSrwVf41ArLsFs0rPfE0g=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:56.250076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f1e88298-3fea-41c2-b3d4-4ccf771ea748 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:01:56.273899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-f1e88298-3fea-41c2-b3d4-4ccf771ea748 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for user 99b3e727e6fa480c90a054a60b68b8d0 and project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:01:56.311957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f1e88298-3fea-41c2-b3d4-4ccf771ea748 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099682 Oct 10 12:01:56.312485 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 191/376] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:01:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:56.392011 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:56.393712 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:56.418164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.418164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.418164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.418164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.420473 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.420473 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.460108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:56.469257 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d6410d07-6cf2-4726-a627-bd918a36c413 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1548 microversion: 2.1 time: 0.295407 Oct 10 12:01:56.475116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 186/377] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:56 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1548 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:56.510792 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:56.511455 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:56.528406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.528901 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.529347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.530055 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.530514 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.530963 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.692912 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:56.706241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:56.707852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:56.709029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8c3d4dbb-5a81-4f28-9660-f12572ef4cc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.325872 Oct 10 12:01:56.709593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 192/378] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:56 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:56.783289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:56.791648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6848bc6f-b18c-443d-8718-fc25084d92ee tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1548 microversion: 2.1 time: 0.298835 Oct 10 12:01:56.806610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 187/379] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:56 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1548 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:56.817216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:56.823016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:56.823784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Searching by: {'deleted': False, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199'} {{(pid=120663) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 12:01:56.838020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.838511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.838965 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.839683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.840133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.840553 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.854410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:56.855081 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:56.863149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.863643 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.867946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.869653 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:56.875889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:56.876552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:56.982197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.multi_cell_list [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120663) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 12:01:57.205094 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:57.223304 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5f6627c8-29fe-4e5a-aa99-61ce04a16dba tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1713 microversion: 2.1 time: 0.365201 Oct 10 12:01:57.224643 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 188/380] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:56 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1713 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:57.254346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-82ad34f0-ef7e-427d-a7d7-adb4f605c4e4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.441849 Oct 10 12:01:57.255124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 193/381] 10.222.0.52 () {58 vars in 1125 bytes} [Mon Oct 10 12:01:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:57.269935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:57.270640 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:57.285448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:57.285712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:57.286159 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:57.287496 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:57.288105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:57.289447 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:57.505151 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:57.515309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-12ec2970-4025-4c4c-838a-0969277350ed tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1548 microversion: 2.1 time: 0.250842 Oct 10 12:01:57.528252 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 189/382] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:57 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1548 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:57.739615 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:57.740329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:57.754017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:57.754963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:57.755621 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:57.756530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:57.757948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:57.758464 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:57.918237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:57.928357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:57.932142 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:57.933902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-82627e74-40fa-463d-a620-ccf4c31b37f4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1739 microversion: 2.20 time: 0.198920 Oct 10 12:01:57.935631 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 194/383] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:57 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:58.485666 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-652171243", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ac8f1d1-c12a-4843-a8c4-2e6d690ca422"}], "security_groups": [{"name": "tempest-securitygroup--612267058"}], "key_name": "tempest-keypair-1086426870", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:58.642977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] validate_networks() for [('2ac8f1d1-c12a-4843-a8c4-2e6d690ca422', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:01:58.961343 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:58.961971 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:58.968364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:58.968849 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:58.969280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:58.969973 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:58.970848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:58.971292 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:59.274931 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:59.283052 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:59.284783 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:59.285927 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3ea8d5c-325c-4419-8594-56a94bde8292 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1721 microversion: 2.20 time: 0.329596 Oct 10 12:01:59.286487 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 195/384] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:01:58 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1721 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:59.291131 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "843f8475-f313-423f-97f5-9bdc44586a7e"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:59.293386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:59.299124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:59.299603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:59.300029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:59.300719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:59.301161 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:59.301765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:59.387133 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:01:59.387802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:01:59.388279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:01:59.388726 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:01:59.389191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:01:59.398628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:59.399142 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:59.399583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:59.400344 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:01:59.400995 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:01:59.401583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:01:59.419223 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:01:59.424345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Getting quotas for user 99b3e727e6fa480c90a054a60b68b8d0 and project b72dcfa7755e499f8f55ade0fde3d7c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:01:59.436353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:01:59.438661 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:01:59.486920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c0f6bdbb-cd92-4471-8598-cbe7742221cd tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.005410 Oct 10 12:01:59.487559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 190/385] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:01:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:01:59.501904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8b4baa86-6047-4b6d-ad2b-68a9e53e16a5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:59.502527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8b4baa86-6047-4b6d-ad2b-68a9e53e16a5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:01:59.562385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8b4baa86-6047-4b6d-ad2b-68a9e53e16a5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:01:59.570179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8b4baa86-6047-4b6d-ad2b-68a9e53e16a5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1245 microversion: 2.1 time: 0.072156 Oct 10 12:01:59.571447 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 191/386] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:01:59 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:00.312870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:00.313537 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:00.319705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:00.320192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:00.320634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:00.321359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:00.321822 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:00.322257 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:00.461084 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:00.469118 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:00.470576 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:00.471777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-484371f9-1c3f-4fc2-be91-8f56286671d3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1721 microversion: 2.20 time: 0.163054 Oct 10 12:02:00.472336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 192/387] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:00 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:00.591849 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:00.592445 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:00.598560 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:00.599161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:00.599635 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:00.600412 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:00.600783 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:00.601204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:00.662501 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:00.670129 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-37e38ec9-fd9c-4c15-be38-6ecac287310d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1249 microversion: 2.1 time: 0.081899 Oct 10 12:02:00.670689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 193/388] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:00 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:01.497821 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:01.498456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:01.505376 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:01.505758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:01.506209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:01.506870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:01.507998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:01.508438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:01.630695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0cbf0b11-664c-4200-9262-8ff2ae8eb7dd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.342879 Oct 10 12:02:01.631918 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 196/389] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:01:59 2022] POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments => generated 194 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:01.654358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:01.667910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:01.670384 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:01.671672 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-241bcaab-d53a-4297-b68e-a620ba78fa5c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1721 microversion: 2.20 time: 0.177833 Oct 10 12:02:01.672230 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 194/390] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:01 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:01.695372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:01.696398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:01.703494 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:01.703982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:01.704414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:01.705154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:01.705603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:01.706195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:01.772307 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:01.780903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ba9fd64c-025f-4d84-a853-0f019cbd52aa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1241 microversion: 2.1 time: 0.091535 Oct 10 12:02:01.781477 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 197/391] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:01 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:02.700088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:02.701210 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:02.725327 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:02.727302 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:02.730714 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:02.731715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:02.732339 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:02.734380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:02.809652 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:02.811122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:02.821211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:02.825798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:02.826719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:02.827744 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:02.828416 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:02.829075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:02.951108 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:02.980938 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-109ff98b-f3e9-4887-9e66-cc3129b85e40 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1315 microversion: 2.1 time: 0.175505 Oct 10 12:02:03.005088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 198/392] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:02 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:03.074436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:03.082574 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:03.086343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:03.087968 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7328bd45-c7c0-48db-9980-c6f9da80c12e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1724 microversion: 2.20 time: 0.393987 Oct 10 12:02:03.088698 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 195/393] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:02 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:03.112621 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5641af2a-f161-4eb7-91b5-e6ea33698032"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:03.115018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:03.121293 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:03.121775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:03.122218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:03.122933 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:03.123399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:03.123819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:03.281725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a8971cfa-7e32-4bec-8ed7-a6880bdf3c30 req-7b09acbf-8e61-43ff-a864-9b85dd37c214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc3237-f592-4db7-9f6a-294f4cea3c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "fa2ac855-9b1f-4330-96cc-cad641c595d3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:03.296648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a8971cfa-7e32-4bec-8ed7-a6880bdf3c30 req-7b09acbf-8e61-43ff-a864-9b85dd37c214 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:03.297672 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a8971cfa-7e32-4bec-8ed7-a6880bdf3c30 req-7b09acbf-8e61-43ff-a864-9b85dd37c214 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:03.300205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a8971cfa-7e32-4bec-8ed7-a6880bdf3c30 req-7b09acbf-8e61-43ff-a864-9b85dd37c214 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:03.344054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a8971cfa-7e32-4bec-8ed7-a6880bdf3c30 req-7b09acbf-8e61-43ff-a864-9b85dd37c214 service nova] Creating event network-vif-unplugged:fa2ac855-9b1f-4330-96cc-cad641c595d3 for instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a on hv-cinder-85061 Oct 10 12:02:03.360311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a8971cfa-7e32-4bec-8ed7-a6880bdf3c30 req-7b09acbf-8e61-43ff-a864-9b85dd37c214 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083149 Oct 10 12:02:03.362315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 196/394] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:03.494411 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-28f5ab28-fd0b-4c39-ae84-3aca567b646a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.385701 Oct 10 12:02:03.495381 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 199/395] 10.222.0.52 () {62 vars in 1364 bytes} [Mon Oct 10 12:02:03 2022] POST /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments => generated 188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:02:03.704681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:03.705379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:03.725045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:03.730126 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:03.731566 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:03.732890 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:03.733531 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:03.734330 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:03.843909 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120662) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 12:02:03.872705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2132578295", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-535509752", "security_groups": [{"name": "tempest-secgroup-smoke-1779695716"}], "block_device_mapping_v2": [{"uuid": "e79fea75-8384-4360-a1c0-328dd5d05b67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "099cba3b-5410-4f1b-a5a9-7c05259222ec"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:04.004433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-eddccf2d-b324-4a9f-a5fe-ee796aa7f6de tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/action" status: 202 len: 0 microversion: 2.20 time: 0.302066 Oct 10 12:02:04.005338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 197/396] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Oct 10 12:02:03 2022] POST /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:02:04.014050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:04.016857 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:04.031097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:04.031594 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:04.032029 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:04.032733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:04.033187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:04.033602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:04.210795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] validate_networks() for [('099cba3b-5410-4f1b-a5a9-7c05259222ec', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:02:04.405338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:04.424336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9587773a-2e6c-4f99-b360-be282c6771e4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.417346 Oct 10 12:02:04.425829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 198/397] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:04 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:04.432407 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:04.433980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:04.441227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:04.442075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:04.442854 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:04.444170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:04.445377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:04.445816 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:04.824335 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:04.832865 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:04.834318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:04.836057 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bf96c4a1-2718-4378-b262-be765ba5eddf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1750 microversion: 2.20 time: 0.408067 Oct 10 12:02:04.851751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 199/398] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:04 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1750 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:05.142056 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:02:05.142705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:02:05.143616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:02:05.144097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:02:05.144563 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:02:05.166665 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:05.167653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:05.168282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:05.169190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:05.169942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:05.170944 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:05.196250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:02:05.205294 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for user ce6a1b5ca7584f90bfe83b73aff1335a and project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:02:05.286115 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:02:05.288903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e79fea75-8384-4360-a1c0-328dd5d05b67',volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:02:05.373309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-efbdefe6-2d68-4cb4-ba7a-685eaa1bab83 req-8b4c0226-b6d2-478f-a130-3de8005dfb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3", "tag": "45df0c70-afe6-4d06-b061-e7e825e93be9"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:05.390524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-efbdefe6-2d68-4cb4-ba7a-685eaa1bab83 req-8b4c0226-b6d2-478f-a130-3de8005dfb50 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:05.393772 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-efbdefe6-2d68-4cb4-ba7a-685eaa1bab83 req-8b4c0226-b6d2-478f-a130-3de8005dfb50 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:05.394325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-efbdefe6-2d68-4cb4-ba7a-685eaa1bab83 req-8b4c0226-b6d2-478f-a130-3de8005dfb50 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:05.414070 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-efbdefe6-2d68-4cb4-ba7a-685eaa1bab83 req-8b4c0226-b6d2-478f-a130-3de8005dfb50 service nova] Creating event network-changed:45df0c70-afe6-4d06-b061-e7e825e93be9 for instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 on hv-cinder-85061 Oct 10 12:02:05.419450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-efbdefe6-2d68-4cb4-ba7a-685eaa1bab83 req-8b4c0226-b6d2-478f-a130-3de8005dfb50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050570 Oct 10 12:02:05.420361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 200/399] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:02:05.431651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:05.459752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:05.461816 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:05.468466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:05.468967 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:05.469396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:05.473236 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:05.474024 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:05.474804 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:05.517112 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-67dc23b1-009e-425f-af20-da2d08c32bff tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.650227 Oct 10 12:02:05.521822 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 200/400] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:02:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:02:05.543587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-17e1b1b4-2232-4edd-bdaa-46289eeb84b3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:05.547275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-17e1b1b4-2232-4edd-bdaa-46289eeb84b3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:05.878294 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-17e1b1b4-2232-4edd-bdaa-46289eeb84b3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:05.886525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-17e1b1b4-2232-4edd-bdaa-46289eeb84b3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1094 microversion: 2.1 time: 0.350171 Oct 10 12:02:05.889171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 201/401] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:05 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1094 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:05.908211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:05.909016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:05.917696 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:05.918240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:05.918836 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:05.919916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:05.920392 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:05.920867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:06.124017 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:06.134390 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a0340851-0853-4404-9016-7c8846213161 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.681503 Oct 10 12:02:06.134852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 201/402] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:05 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:06.234049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:06.237422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:06.243479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:06.244967 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:06.246130 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-93aa7e21-9e15-417a-9e4d-328a820a2146 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1752 microversion: 2.20 time: 0.355942 Oct 10 12:02:06.246690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 202/403] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:05 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1752 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:06.910397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:06.911041 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:06.917485 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:06.918003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:06.918440 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:06.919170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:06.919636 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:06.920065 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:06.983507 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:06.992900 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0f86f72b-7b03-404f-880a-8a4574272b24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1192 microversion: 2.1 time: 0.086347 Oct 10 12:02:06.993471 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 202/404] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:06 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:07.158547 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:07.159279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:07.167011 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:07.167525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:07.167985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:07.168668 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:07.169288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:07.169705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:07.283195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:07.283195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:07.283733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:07.284299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:07.284910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:07.285648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:07.286319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:07.286987 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:07.375082 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:07.383148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4f987525-9f46-4200-97b1-f79c02fd5750 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.229633 Oct 10 12:02:07.383719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 203/405] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:07 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:07.439772 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:07.442065 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:07.449927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:07.451570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:07.452736 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b4e305dc-89cc-42f9-afa6-0c2b652ae82c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1752 microversion: 2.20 time: 0.183483 Oct 10 12:02:07.453297 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 203/406] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:07 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:08.015159 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:08.015804 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:08.021939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:08.022422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:08.023395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:08.024085 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:08.024541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:08.024965 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:08.088857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:08.096527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2b2d60b2-b5b3-4eeb-b97b-5806c2be6478 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1192 microversion: 2.1 time: 0.085214 Oct 10 12:02:08.097101 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 204/407] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:08 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:08.408734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:08.409357 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:08.416712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:08.417215 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:08.417829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:08.418503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:08.419001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:08.419442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:08.477401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:08.478011 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:08.487059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:08.487059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:08.487059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:08.487059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:08.487412 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:08.487412 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:08.596703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:08.608036 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4ce1d24c-dc49-4589-a3a6-6b6690f2efe8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.203536 Oct 10 12:02:08.608627 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 204/408] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:08 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:08.692266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:08.701858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:08.703664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:08.705010 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a9c48396-a087-40e2-b7a7-9d6a0aa140d4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1752 microversion: 2.20 time: 0.231441 Oct 10 12:02:08.719247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 205/409] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:08 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:09.121052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:09.123895 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:09.138125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.151404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.153246 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.158581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.161636 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.162363 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.324038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:09.333944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0dc0a18a-5186-433f-b591-ac29978e2139 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1192 microversion: 2.1 time: 0.217587 Oct 10 12:02:09.334612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 205/410] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:09 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1192 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:09.530352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:09.530985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:09.537600 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.538075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.539130 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.539813 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.540260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.540677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.635482 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:09.636093 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:09.637910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:09.638660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=8 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:09.644544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.645033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.645471 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.646195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.646707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.647162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.666767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:09.683901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-84001f24-021d-4814-aedf-3c6d7d7722c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1594 microversion: 2.1 time: 0.157109 Oct 10 12:02:09.684686 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 206/411] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:09 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:09.730489 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:09.731156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:09.741059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.741689 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.742659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.743663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:09.744286 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:09.744803 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:09.801501 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:09.815017 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8d509bc1-96d0-44bd-841e-ffc4888f3c38 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.183426 Oct 10 12:02:09.816202 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 206/412] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:09 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:10.100861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:10.114671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:10.116145 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:10.117911 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8651de67-7e7c-4d3b-9040-6cc8c16338e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1752 microversion: 2.20 time: 0.391287 Oct 10 12:02:10.131780 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 207/413] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:09 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1752 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:10.359008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:10.359780 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:10.369546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:10.370534 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:10.371093 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:10.372379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:10.372924 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:10.373360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:10.497282 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:10.508520 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4e3c31ce-330a-473d-b852-8a3f1273c3ce tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1210 microversion: 2.1 time: 0.154303 Oct 10 12:02:10.522726 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 207/414] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:10 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:10.838785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:10.839686 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:10.855477 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:10.856131 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:10.856568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:10.857655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:10.858111 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:10.858537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:11.143725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:11.144442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:11.155662 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:11.157408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:11.158811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:11.159741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:11.161641 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:11.162078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:11.257479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:11.280418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4f4f5e05-6981-4a40-8173-95dd05c14fa8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.446265 Oct 10 12:02:11.282638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 208/415] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:10 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:11.317140 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-fc6b779b-f728-4a94-99e3-827cbef8127f req-6f361e08-011f-4af0-86d0-a1f2006ec9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3", "name": "network-vif-plugged", "status": "completed", "tag": "45df0c70-afe6-4d06-b061-e7e825e93be9"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:11.330776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fc6b779b-f728-4a94-99e3-827cbef8127f req-6f361e08-011f-4af0-86d0-a1f2006ec9f1 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:11.331638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fc6b779b-f728-4a94-99e3-827cbef8127f req-6f361e08-011f-4af0-86d0-a1f2006ec9f1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:11.332298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fc6b779b-f728-4a94-99e3-827cbef8127f req-6f361e08-011f-4af0-86d0-a1f2006ec9f1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:11.364037 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-fc6b779b-f728-4a94-99e3-827cbef8127f req-6f361e08-011f-4af0-86d0-a1f2006ec9f1 service nova] Creating event network-vif-plugged:45df0c70-afe6-4d06-b061-e7e825e93be9 for instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 on hv-cinder-85061 Oct 10 12:02:11.373109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-fc6b779b-f728-4a94-99e3-827cbef8127f req-6f361e08-011f-4af0-86d0-a1f2006ec9f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060686 Oct 10 12:02:11.374369 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 209/416] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:02:11.450404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:11.460591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:11.462385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:11.463875 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-97d50c41-ef28-4746-b64f-9885d7f869a8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.324352 Oct 10 12:02:11.495845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 208/417] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:11 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:11.536840 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:11.539357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:11.545530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:11.546278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:11.547069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:11.547961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:11.548800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:11.549441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:11.731585 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:11.742485 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d0f75cd-3056-4bad-910e-f819ea50ca90 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1278 microversion: 2.1 time: 0.211034 Oct 10 12:02:11.743335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 210/418] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:11 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:12.147077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-014fa7ac-f7df-4914-8d41-d38846ae905c req-a083b3c4-fedc-475b-8048-8f8197394d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfd5ad5-1c5f-46b8-9db7-189214d74a56", "tag": "8350774c-a156-46d0-bb3c-69064aad8304"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:12.161341 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-014fa7ac-f7df-4914-8d41-d38846ae905c req-a083b3c4-fedc-475b-8048-8f8197394d40 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:12.162087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-014fa7ac-f7df-4914-8d41-d38846ae905c req-a083b3c4-fedc-475b-8048-8f8197394d40 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:12.164467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-014fa7ac-f7df-4914-8d41-d38846ae905c req-a083b3c4-fedc-475b-8048-8f8197394d40 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:12.179669 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-014fa7ac-f7df-4914-8d41-d38846ae905c req-a083b3c4-fedc-475b-8048-8f8197394d40 service nova] Creating event network-changed:8350774c-a156-46d0-bb3c-69064aad8304 for instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 on hv-cinder-85061 Oct 10 12:02:12.185256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-014fa7ac-f7df-4914-8d41-d38846ae905c req-a083b3c4-fedc-475b-8048-8f8197394d40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042572 Oct 10 12:02:12.191630 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 209/419] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:12.305999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:12.307341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:12.322271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:12.323165 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:12.323894 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:12.325132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:12.325850 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:12.326504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:12.494754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:12.496108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:12.512184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:12.515377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:12.517322 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:12.518092 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:12.518560 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:12.519019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:12.899812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:12.911478 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-76d68653-692b-44d5-b3c3-c0441945cde0 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.609701 Oct 10 12:02:12.913461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:12.914251 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 211/420] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:12 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:12.923295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:12.923982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:12.931092 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:12.931867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:12.932552 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:12.933469 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:12.934155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:12.934792 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:12.939827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:12.946042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:12.948013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d07b7952-b5d8-4d56-a0fd-30a6197bf872 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.458086 Oct 10 12:02:12.965737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 210/421] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:12 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:13.569729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:13.586576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c1debd1f-2dad-463c-a576-845b228f25be tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.670800 Oct 10 12:02:13.587194 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 212/422] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:12 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:13.819196 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ddb41fbf-9c31-4864-8505-b4c5dd85ddfb req-ec9ceb99-208d-460f-a0be-32b54fd53047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c012add-b9da-448b-8444-af9e38053fc1", "tag": "c7ad4161-200b-4965-9f0e-a49f6ad3a6eb"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:13.860718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ddb41fbf-9c31-4864-8505-b4c5dd85ddfb req-ec9ceb99-208d-460f-a0be-32b54fd53047 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:13.864821 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ddb41fbf-9c31-4864-8505-b4c5dd85ddfb req-ec9ceb99-208d-460f-a0be-32b54fd53047 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:13.865500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ddb41fbf-9c31-4864-8505-b4c5dd85ddfb req-ec9ceb99-208d-460f-a0be-32b54fd53047 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:13.881940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ddb41fbf-9c31-4864-8505-b4c5dd85ddfb req-ec9ceb99-208d-460f-a0be-32b54fd53047 service nova] Creating event network-changed:c7ad4161-200b-4965-9f0e-a49f6ad3a6eb for instance 7c012add-b9da-448b-8444-af9e38053fc1 on hv-cinder-85061 Oct 10 12:02:13.896878 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ddb41fbf-9c31-4864-8505-b4c5dd85ddfb req-ec9ceb99-208d-460f-a0be-32b54fd53047 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082378 Oct 10 12:02:13.901352 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 211/423] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:13.939093 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:13.939739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:13.946806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:13.947537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:13.948175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:13.948968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:13.949482 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:13.949916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:13.956034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-199775291"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:13.956781 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:13.963627 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:13.964353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:13.964893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:13.965679 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:13.966300 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:13.966748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:14.254456 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:14.264010 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e6a72947-5a62-4a75-8145-4684d4249b6b tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1370 microversion: 2.1 time: 0.329947 Oct 10 12:02:14.264739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 213/424] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:13 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:14.269693 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:14.270417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:14.276985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:14.277785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:14.278412 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:14.279214 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:14.279889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:14.280720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:14.291670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.network.security_group_api [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Adding security group b804ceeb-3ba4-4d3b-b277-58ea18d49ef8 to port 8350774c-a156-46d0-bb3c-69064aad8304 Oct 10 12:02:14.525075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:14.540112 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:14.541556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:14.542751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a11cf3aa-8279-42f3-9585-52eb9c44946d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.276844 Oct 10 12:02:14.548964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 214/425] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:14 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:14.610164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:14.610863 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:14.618228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:14.618731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:14.622017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:14.622757 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:14.623264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:14.623706 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:14.831667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cd0830a2-714a-4185-a255-7f72c6536eb6 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/action" status: 202 len: 0 microversion: 2.1 time: 0.879655 Oct 10 12:02:14.835549 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 212/426] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:02:13 2022] POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/action => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:02:14.841808 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:14.842715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:14.850176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:14.851459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:14.852060 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:14.853263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:14.853882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:14.854474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:14.945072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:14.957094 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-16018178-154e-498d-bb3b-70acddb4d74d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.350895 Oct 10 12:02:14.971126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 215/427] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:14 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:15.195964 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:15.205171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-74029bd5-9844-4f19-9d0c-f6b4ee20d544 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1640 microversion: 2.1 time: 0.368225 Oct 10 12:02:15.205759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 213/428] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:14 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1640 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:15.288772 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:15.289688 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:15.293913 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:15.305426 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:15.306036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:15.306603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:15.307750 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:15.308298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:15.308817 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:15.568783 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:15.570284 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:15.577042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:15.577527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:15.577962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:15.579027 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:15.579569 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:15.579994 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:15.667317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:15.674858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-01681544-0420-4b3b-ae25-8f8e38330424 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1565 microversion: 2.1 time: 0.390805 Oct 10 12:02:15.675458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 216/429] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:15 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1565 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:15.698378 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:15.698870 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:15.706438 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:15.706817 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:15.707280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:15.707997 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:15.708418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:15.708913 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:15.833753 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4957ffeb-3aaa-4e25-89a0-0103c5b00a8e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139629 Oct 10 12:02:15.834448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 217/430] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 12:02:15 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:02:15.919772 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-8135e8e7-4cc9-4e55-9f2e-a8dc872ba85e req-5e28ba98-8a86-4529-80b8-f985c05ba1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfd5ad5-1c5f-46b8-9db7-189214d74a56", "tag": "8350774c-a156-46d0-bb3c-69064aad8304"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:15.925223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=12 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:15.931330 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:15.941088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-8135e8e7-4cc9-4e55-9f2e-a8dc872ba85e req-5e28ba98-8a86-4529-80b8-f985c05ba1b7 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:15.941768 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-8135e8e7-4cc9-4e55-9f2e-a8dc872ba85e req-5e28ba98-8a86-4529-80b8-f985c05ba1b7 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:15.942286 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-8135e8e7-4cc9-4e55-9f2e-a8dc872ba85e req-5e28ba98-8a86-4529-80b8-f985c05ba1b7 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:15.945408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:15.950785 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:15.954694 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-37a522d5-cc48-4e02-94e6-e3c62a4516c5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.389910 Oct 10 12:02:15.956187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 214/431] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:15 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:15.964238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-8135e8e7-4cc9-4e55-9f2e-a8dc872ba85e req-5e28ba98-8a86-4529-80b8-f985c05ba1b7 service nova] Creating event network-changed:8350774c-a156-46d0-bb3c-69064aad8304 for instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 on hv-cinder-85061 Oct 10 12:02:15.975184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-8135e8e7-4cc9-4e55-9f2e-a8dc872ba85e req-5e28ba98-8a86-4529-80b8-f985c05ba1b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059519 Oct 10 12:02:15.976104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 218/432] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:02:15.989803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:15.993825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:16.005529 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:16.006088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:16.008087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:16.008905 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:16.009434 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:16.011037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:16.486298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:16.496517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ba112c74-c290-4857-9e05-35403df813d0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.518725 Oct 10 12:02:16.499687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 215/433] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:15 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:16.985767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:16.986473 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:16.992630 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:16.993118 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:16.993556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:16.994287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:16.994743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:16.995193 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:17.460708 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:17.469263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:17.470702 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:17.471903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b4d8be93-0093-49b5-9be8-da33e9b9a106 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.491226 Oct 10 12:02:17.472472 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 219/434] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:16 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:17.521569 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:17.522794 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:17.532610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:17.533925 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:17.534498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:17.535626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:17.536319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:17.536855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:17.722357 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:17.732228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5f95c7b7-58b6-4223-bbac-76f0d372a70a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.214277 Oct 10 12:02:17.734927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 216/435] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:17 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:18.000576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7fe4effb-4996-4c8a-a4ed-48f93fd95b8b req-cea2c651-cd06-45a6-8f6f-27f0911464b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3", "tag": "45df0c70-afe6-4d06-b061-e7e825e93be9"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:18.011541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7fe4effb-4996-4c8a-a4ed-48f93fd95b8b req-cea2c651-cd06-45a6-8f6f-27f0911464b2 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:18.012174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7fe4effb-4996-4c8a-a4ed-48f93fd95b8b req-cea2c651-cd06-45a6-8f6f-27f0911464b2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:18.012709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7fe4effb-4996-4c8a-a4ed-48f93fd95b8b req-cea2c651-cd06-45a6-8f6f-27f0911464b2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:18.036302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7fe4effb-4996-4c8a-a4ed-48f93fd95b8b req-cea2c651-cd06-45a6-8f6f-27f0911464b2 service nova] Creating event network-changed:45df0c70-afe6-4d06-b061-e7e825e93be9 for instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 on hv-cinder-85061 Oct 10 12:02:18.045691 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7fe4effb-4996-4c8a-a4ed-48f93fd95b8b req-cea2c651-cd06-45a6-8f6f-27f0911464b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048669 Oct 10 12:02:18.046307 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 220/436] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:18.496253 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:18.496909 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:18.505493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:18.506397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:18.506847 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:18.507680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:18.508149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:18.508582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:18.689833 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:18.699484 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:18.700905 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:18.702065 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-27ee2224-90b2-4a1c-8d17-f168fdcec58c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.209985 Oct 10 12:02:18.702623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 217/437] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:18 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:18.761020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:18.762212 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:18.769827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:18.770822 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:18.771507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:18.772448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:18.773104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:18.773503 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:18.930414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:18.934071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:18.939315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-073127ec-fb21-4c94-b4ee-2c31c31a1c4b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.182556 Oct 10 12:02:18.940074 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 221/438] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:18 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:19.729717 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:19.730568 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:19.734299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:19.738453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:19.738987 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:19.739432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:19.740144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:19.740604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:19.741536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:19.886499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:19.895138 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:19.896586 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:19.898277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b74d25c0-93e0-406a-b084-130994d1a054 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.173624 Oct 10 12:02:19.898848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 218/439] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:19 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:19.963493 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:19.964504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:19.971534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:19.972420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:19.973154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:19.974222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:19.975245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:19.976498 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:20.122579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:20.131049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0298371a-3873-4cba-b1ef-af498bebb23b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.172637 Oct 10 12:02:20.131626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 222/440] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:19 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:20.924133 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:20.924776 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:20.931654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:20.932144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:20.932584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:20.933274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:20.933733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:20.934160 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:21.076075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:21.086835 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:21.088595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:21.090121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0f7c5e4-19c1-4de8-811a-16114398f591 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.169833 Oct 10 12:02:21.090839 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 219/441] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:20 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:21.154106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:21.154726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:21.161460 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:21.161950 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:21.162387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:21.163154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:21.163616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:21.164042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:21.310660 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:21.321335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-08903ad2-321b-40e7-a332-895dfd3cb5ee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.170977 Oct 10 12:02:21.331518 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 223/442] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:21 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:22.114871 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:22.115572 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:22.122194 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:22.122703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:22.123144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:22.123849 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:22.124312 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:22.124743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:22.269071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:22.278208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:22.279718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:22.280874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-699ce9d8-9f48-4287-a413-b3b743b5214f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.169918 Oct 10 12:02:22.281436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 220/443] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:22 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:22.345071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:22.346807 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:22.354960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:22.355455 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:22.355889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:22.356769 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:22.357225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:22.357685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:22.496765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:22.504622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfa5f4cc-e6a4-40ef-8d30-f86a871d8c32 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.164415 Oct 10 12:02:22.505191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 224/444] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:22 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:23.306730 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:23.307380 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:23.313768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:23.314252 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:23.314690 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:23.315410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:23.315871 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:23.316296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:23.453269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:23.463464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:23.464946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:23.466394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-58d34757-bad0-4aa1-844d-6f56ddf3c273 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.163565 Oct 10 12:02:23.467193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 221/445] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:23 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:23.526554 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:23.527192 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:23.533655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:23.534138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:23.534574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:23.535300 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:23.535753 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:23.536176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:23.685047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:23.693637 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-02537075-4a28-4b96-9d4d-2d3869fc1452 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.170814 Oct 10 12:02:23.694314 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 225/446] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:23 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:24.491802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:24.492409 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:24.498864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:24.499415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:24.499857 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:24.500553 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:24.501010 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:24.501433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:24.504060 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:24.637391 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:24.645937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:24.647417 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:24.648572 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1f463005-5ed1-4e34-a25c-25e67e3a5bb1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.161329 Oct 10 12:02:24.649163 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 222/447] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:24 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:24.715613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:24.717132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:24.725158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:24.727219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:24.728271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:24.729478 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:24.730298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:24.731036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:24.862562 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:24.870826 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d5291569-ff83-4b45-bf08-6c9e96882f84 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.159216 Oct 10 12:02:24.871515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 226/448] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:24 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:25.674365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:25.674970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:25.682090 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:25.682577 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:25.683054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:25.683752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:25.684211 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:25.684670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:25.829775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:25.839240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:25.840716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:25.842072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7e91a36f-4cbc-43ab-8169-7fc081c6b73d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.171829 Oct 10 12:02:25.842638 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 223/449] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:25 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:25.893429 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:25.894037 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:25.901303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:25.901783 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:25.902217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:25.902923 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:25.903407 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:25.903832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:26.046791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:26.054642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-165f2311-ca9b-4467-a179-9533231d2be2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.165015 Oct 10 12:02:26.055240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 227/450] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:25 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:26.867932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:26.869161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:26.875625 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:26.876170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:26.876544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:26.877326 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:26.877707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:26.878241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:27.012479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:27.021862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:27.023422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:27.025322 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7318e630-7819-43df-a383-8c477569406d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.161453 Oct 10 12:02:27.025956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 224/451] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:26 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:27.078227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:27.078836 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:27.085285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:27.085765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:27.086198 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:27.087540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:27.087999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:27.088493 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:27.220619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:27.228339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c6aa8760-71eb-4316-aa78-a197e1af3dde tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.153986 Oct 10 12:02:27.228902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 228/452] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:27 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:28.050350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:28.051018 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:28.058317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:28.058802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:28.059267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:28.059985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:28.060441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:28.060867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:28.251127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:28.251729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:28.258288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:28.259354 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:28.259755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:28.260451 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:28.260903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:28.261318 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:28.282605 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:28.291362 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:28.292810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:28.293971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d75f21a-f0e4-42e9-a781-30a1925c7440 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.247474 Oct 10 12:02:28.294540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 225/453] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:28 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:28.393714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:28.402130 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2264a727-caa7-4b12-9b07-50de48304a44 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.154889 Oct 10 12:02:28.402693 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 229/454] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:28 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:29.319077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:29.319605 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:29.325999 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:29.326490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:29.326954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:29.327651 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:29.328110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:29.328538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:29.423726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:29.424329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:29.431251 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:29.431727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:29.432156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:29.432840 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:29.433290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:29.433708 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:29.459457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:29.468731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:29.470180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:29.471364 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-27157ad9-77d4-4212-b02f-900411530928 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.156315 Oct 10 12:02:29.471926 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 226/455] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:29 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:29.561528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:29.569185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-62db589e-8b18-4432-87d9-98d592c891f5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.149173 Oct 10 12:02:29.569687 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 230/456] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:29 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:30.498044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:30.498664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:30.505165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:30.505651 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:30.506094 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:30.506789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:30.507279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:30.507712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:30.590917 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:30.591525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:30.597916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:30.598393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:30.598821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:30.599552 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:30.600007 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:30.600430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:30.635556 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:30.644237 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:30.645779 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:30.647132 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0fc5398f-1e99-4ff9-b32b-fcef9241e9a3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.152870 Oct 10 12:02:30.647694 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 227/457] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:30 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:30.737556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:30.745948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a59830ad-84b5-4552-ab4b-fc0dd217841c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.159081 Oct 10 12:02:30.746527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 231/458] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:30 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:31.674877 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:31.675541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:31.682665 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:31.683179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:31.683610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:31.684290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:31.684739 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:31.685165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:31.768563 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:31.769178 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:31.776275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:31.776763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:31.777201 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:31.777898 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:31.778359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:31.778783 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:31.812523 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:31.821462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:31.822910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:31.824065 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e4d0f283-9024-40d8-ac99-26875f0d48ed tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.153103 Oct 10 12:02:31.824632 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 228/459] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:31 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:31.910504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:31.918877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0841eea7-58dc-4465-82a6-70cd4cce5efb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.154340 Oct 10 12:02:31.919470 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 232/460] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:31 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:32.849522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:32.850129 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:32.856823 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:32.857305 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:32.857738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:32.858418 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:32.858874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:32.859320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:32.941608 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:32.942211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:32.949444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:32.949923 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:32.950350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:32.951081 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:32.951532 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:32.952069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:32.987461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:32.996159 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:32.997626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:32.998810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d372c3b-cc84-4ced-b7b3-e2f2cded6fd7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.153163 Oct 10 12:02:32.999412 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 229/461] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:32 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:33.082754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:33.091062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a7b17a1d-0f1f-4edf-95bf-5b06598fb85f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.153168 Oct 10 12:02:33.091638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 233/462] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:32 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:33.419207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-498e2dea-06e9-49d3-ac15-bd535c0935eb req-e59f7996-33ea-47f0-a968-9befd3a49e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c012add-b9da-448b-8444-af9e38053fc1", "name": "network-vif-plugged", "status": "completed", "tag": "c7ad4161-200b-4965-9f0e-a49f6ad3a6eb"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:33.428927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-498e2dea-06e9-49d3-ac15-bd535c0935eb req-e59f7996-33ea-47f0-a968-9befd3a49e8d service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:33.429406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-498e2dea-06e9-49d3-ac15-bd535c0935eb req-e59f7996-33ea-47f0-a968-9befd3a49e8d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:33.429832 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-498e2dea-06e9-49d3-ac15-bd535c0935eb req-e59f7996-33ea-47f0-a968-9befd3a49e8d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:33.440550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-498e2dea-06e9-49d3-ac15-bd535c0935eb req-e59f7996-33ea-47f0-a968-9befd3a49e8d service nova] Creating event network-vif-plugged:c7ad4161-200b-4965-9f0e-a49f6ad3a6eb for instance 7c012add-b9da-448b-8444-af9e38053fc1 on hv-cinder-85061 Oct 10 12:02:33.445436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-498e2dea-06e9-49d3-ac15-bd535c0935eb req-e59f7996-33ea-47f0-a968-9befd3a49e8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035746 Oct 10 12:02:33.446229 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 230/463] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:34.025447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:34.026049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:34.032507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:34.032977 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:34.033406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:34.034080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:34.034525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:34.034976 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:34.114579 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:34.115579 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:34.122241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:34.122726 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:34.123198 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:34.123884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:34.124336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:34.124756 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:34.165524 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:34.174376 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:34.175845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:34.177275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7cda477a-1f49-42cf-b749-d029972e316c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.156151 Oct 10 12:02:34.177864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 234/464] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:34 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:34.262489 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:34.270954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a565faae-e702-4e22-a4f4-a98bf0a9c0aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.160961 Oct 10 12:02:34.271514 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 231/465] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:34 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:35.204431 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:35.205028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:35.212068 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:35.212543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:35.212972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:35.213651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:35.214099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:35.214516 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:35.293411 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:35.294052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:35.300589 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:35.301069 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:35.301500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:35.302453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:35.302922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:35.303344 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:35.351232 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:35.360585 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:35.362020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:35.363185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-95f647c0-f8a1-4d37-bf21-da334212e866 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.162608 Oct 10 12:02:35.363738 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 235/466] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:35 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:35.435547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:35.443498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d02a1ab5-d89e-4965-bcf3-4e2f791db45b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1266 microversion: 2.1 time: 0.154160 Oct 10 12:02:35.444066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 232/467] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:35 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:36.388911 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:36.389520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:36.391953 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=73 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:36.397807 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:36.398288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:36.398720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:36.399955 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:36.400423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:36.400848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:36.466309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:36.466943 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:36.473346 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:36.473823 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:36.474252 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:36.474966 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:36.475426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:36.475846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:36.562350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:36.570993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:36.572431 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:36.573638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1c31aa9b-65a9-405a-b0fe-8434c38584fe tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.188585 Oct 10 12:02:36.574135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 236/468] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:36 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:02:36.624740 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:36.632507 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6f02c327-71a4-4e9d-ae4f-5bf9b71fde72 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1453 microversion: 2.1 time: 0.170187 Oct 10 12:02:36.633081 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 233/469] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:36 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:36.654004 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:36.654553 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:36.660421 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:36.660898 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:36.661333 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:36.662014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:36.662471 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:36.662921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:36.793885 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:36.801488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5e593e7c-1d99-41bf-a9f8-689d75f5519f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1453 microversion: 2.1 time: 0.151379 Oct 10 12:02:36.802322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 237/470] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:36 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:37.597716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:37.598408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:37.605947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:37.606431 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:37.606866 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:37.607582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:37.608034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:37.608462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:37.819234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:37.827838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:37.829274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:37.830420 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5300cd24-0919-4f82-86d4-9178d7f774e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.236767 Oct 10 12:02:37.830990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 234/471] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:37 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:38.856870 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:38.857473 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:38.863629 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-d429ba38-946f-46bc-b055-7a9d61423d6c req-469925fe-594f-4f1a-8c54-a660b00e192e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c012add-b9da-448b-8444-af9e38053fc1", "tag": "c7ad4161-200b-4965-9f0e-a49f6ad3a6eb"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:38.872147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:38.872629 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:38.873055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:38.873743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:38.874194 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:38.874614 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:38.885593 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d429ba38-946f-46bc-b055-7a9d61423d6c req-469925fe-594f-4f1a-8c54-a660b00e192e service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:38.886084 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d429ba38-946f-46bc-b055-7a9d61423d6c req-469925fe-594f-4f1a-8c54-a660b00e192e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:38.886533 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d429ba38-946f-46bc-b055-7a9d61423d6c req-469925fe-594f-4f1a-8c54-a660b00e192e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:38.894859 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:38.897830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-d429ba38-946f-46bc-b055-7a9d61423d6c req-469925fe-594f-4f1a-8c54-a660b00e192e service nova] Creating event network-changed:c7ad4161-200b-4965-9f0e-a49f6ad3a6eb for instance 7c012add-b9da-448b-8444-af9e38053fc1 on hv-cinder-85061 Oct 10 12:02:38.903467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-d429ba38-946f-46bc-b055-7a9d61423d6c req-469925fe-594f-4f1a-8c54-a660b00e192e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043249 Oct 10 12:02:38.904461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 235/472] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:39.009471 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:39.019945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:39.021460 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:39.022683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dbaedd6f-4e69-47c5-a846-59c5b7fa0e75 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.169945 Oct 10 12:02:39.023496 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 238/473] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:38 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:40.050225 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:40.050964 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:40.057789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:40.058274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:40.058707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:40.059430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:40.059892 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:40.060319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:40.197174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:40.205870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:40.207345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:40.208497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-587ad832-abde-4477-b0f6-06e9c1123277 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.163455 Oct 10 12:02:40.209056 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 236/474] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:40 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:41.233571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:41.234244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:41.240891 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:41.241363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:41.241791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:41.242495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:41.242975 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:41.243417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:41.372113 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:41.380616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:41.382035 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:41.383252 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5333b9c0-630f-4c21-a309-add081c0ebba tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.153501 Oct 10 12:02:41.383816 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 239/475] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:41 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:41.578166 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-6ca1ba47-2d07-4942-b836-91ca3cf4750f req-8666980c-aa90-4393-a707-afd097e78675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc3237-f592-4db7-9f6a-294f4cea3c9a", "name": "network-vif-plugged", "status": "completed", "tag": "fa2ac855-9b1f-4330-96cc-cad641c595d3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:41.588919 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6ca1ba47-2d07-4942-b836-91ca3cf4750f req-8666980c-aa90-4393-a707-afd097e78675 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:41.589409 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6ca1ba47-2d07-4942-b836-91ca3cf4750f req-8666980c-aa90-4393-a707-afd097e78675 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:41.589983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6ca1ba47-2d07-4942-b836-91ca3cf4750f req-8666980c-aa90-4393-a707-afd097e78675 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:41.601347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-6ca1ba47-2d07-4942-b836-91ca3cf4750f req-8666980c-aa90-4393-a707-afd097e78675 service nova] Creating event network-vif-plugged:fa2ac855-9b1f-4330-96cc-cad641c595d3 for instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a on hv-cinder-85061 Oct 10 12:02:41.606184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-6ca1ba47-2d07-4942-b836-91ca3cf4750f req-8666980c-aa90-4393-a707-afd097e78675 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031769 Oct 10 12:02:41.606851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 237/476] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:42.409349 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:42.409963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:42.417326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:42.417810 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:42.418249 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:42.418965 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:42.419428 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:42.419858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:42.547255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:42.555918 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:42.557413 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:42.558511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ef7ba6dc-ee50-4f7d-b1c9-871a4b68d00b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.153070 Oct 10 12:02:42.559107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 240/477] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:42 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:43.584818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:43.585508 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:43.592316 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:43.592802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:43.593245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:43.593932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:43.594392 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:43.594824 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:43.724664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:43.733202 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:43.734663 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:43.735914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d734c11d-2cb5-44d2-ab85-7730cdc23fc8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.155910 Oct 10 12:02:43.736471 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 238/478] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:43 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:44.762117 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:44.762634 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:44.769045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:44.769521 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:44.769956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:44.770643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:44.771136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:44.771586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:44.906884 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:44.915591 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:44.917073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:44.918242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-534bdfd3-9aa8-4a11-946c-2285e4cc1af6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1808 microversion: 2.20 time: 0.160758 Oct 10 12:02:44.918812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 241/479] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:44 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:45.943077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:45.943685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:45.950306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:45.950790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:45.951288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:45.951969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:45.952419 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:45.952840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:46.081675 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:46.090744 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:46.092202 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:46.093355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-400db852-8fc9-40eb-8d0f-cdcc09319653 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1795 microversion: 2.20 time: 0.154150 Oct 10 12:02:46.093907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 239/480] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:02:45 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:46.773722 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:46.774228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:46.780754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:46.781246 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:46.781682 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:46.782372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:46.782829 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:46.783283 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:46.806578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7372e5e4-7683-42a1-ae85-e947edbfa59b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef/ips" status: 200 len: 149 microversion: 2.1 time: 0.036862 Oct 10 12:02:46.807241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 242/481] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:02:46 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:46.818732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "978bc04e-e74f-4841-b456-33236d73f2c5"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:46.821938 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:46.827889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:46.828376 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:46.828816 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:46.829507 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:46.829968 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:46.830427 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:46.902254 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:46.908383 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Invalid volume: volume 978bc04e-e74f-4841-b456-33236d73f2c5 is already attached to instances: 0ddfe581-92c6-4065-9fff-7ebe3462658b Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef/os-volume_attachments HTTP/1.1 Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 74 Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:02:46.910072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {"volumeAttachment": {"volumeId": "978bc04e-e74f-4841-b456-33236d73f2c5"}} Oct 10 12:02:46.911588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Invalid volume: volume 978bc04e-e74f-4841-b456-33236d73f2c5 is already attached to instances: 0ddfe581-92c6-4065-9fff-7ebe3462658b Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '0a6a752b-46c1-419a-a67f-b438ec73dfef', 'body': {'volumeAttachment': {'volumeId': '978bc04e-e74f-4841-b456-33236d73f2c5'}}} Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 978bc04e-e74f-4841-b456-33236d73f2c5 is already attached to instances: 0ddfe581-92c6-4065-9fff-7ebe3462658b Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:02:46.912395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 978bc04e-e74f-4841-b456-33236d73f2c5 is already attached to instances: 0ddfe581-92c6-4065-9fff-7ebe3462658b Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:02:46.913904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 978bc04e-e74f-4841-b456-33236d73f2c5 is already attached to instances: 0ddfe581-92c6-4065-9fff-7ebe3462658b Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 400 to user: Invalid volume: volume 978bc04e-e74f-4841-b456-33236d73f2c5 is already attached to instances: 0ddfe581-92c6-4065-9fff-7ebe3462658b {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e86fdc8d-0925-472b-b551-1257810d3888 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096784 Oct 10 12:02:46.915753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 240/482] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:02:46 2022] POST /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:02:46.920576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:46.921122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:46.927337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:46.927818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:46.928254 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:46.928938 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:46.929397 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:46.929821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:46.955002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:02:47.028712 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a65b4be7-a3b7-42ac-8133-67b683e6ae63 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 204 len: 0 microversion: 2.1 time: 0.111595 Oct 10 12:02:47.029213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 243/483] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:02:46 2022] DELETE /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:02:47.039308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:47.040466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:47.047570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:47.048058 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:47.048503 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:47.049200 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:47.049664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:47.050099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:47.182179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:47.190142 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd298b02-c352-4101-95c4-e63139f48796 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1681 microversion: 2.1 time: 0.155989 Oct 10 12:02:47.190706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 241/484] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:47 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:48.214280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:48.215024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:48.221340 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:48.221822 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:48.222256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:48.222964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:48.223422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:48.223844 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:48.348882 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:48.357150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5c8d9fc6-5dd0-41d7-8ea9-fd24274d744b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1681 microversion: 2.1 time: 0.147645 Oct 10 12:02:48.357713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 244/485] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:48 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:49.380121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:49.380741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:49.387111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:49.387594 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:49.388031 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:49.388726 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:49.389217 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:49.389642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:49.674650 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:49.682654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b80e3945-7400-431b-8d46-da54bc78e0cb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1681 microversion: 2.1 time: 0.306369 Oct 10 12:02:49.683312 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 242/486] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:49 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:50.128076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-22e787da-23ef-489c-b0fd-6044826eb9f2 req-10641b46-619f-4ae9-90b4-2c0ad6d2b784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6a752b-46c1-419a-a67f-b438ec73dfef", "name": "network-vif-deleted", "tag": "8f41ae8d-ac23-4143-85d3-27cb22c3af90"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:50.138460 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-22e787da-23ef-489c-b0fd-6044826eb9f2 req-10641b46-619f-4ae9-90b4-2c0ad6d2b784 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:50.138985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-22e787da-23ef-489c-b0fd-6044826eb9f2 req-10641b46-619f-4ae9-90b4-2c0ad6d2b784 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:50.139592 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-22e787da-23ef-489c-b0fd-6044826eb9f2 req-10641b46-619f-4ae9-90b4-2c0ad6d2b784 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:50.151990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-22e787da-23ef-489c-b0fd-6044826eb9f2 req-10641b46-619f-4ae9-90b4-2c0ad6d2b784 service nova] Creating event network-vif-deleted:8f41ae8d-ac23-4143-85d3-27cb22c3af90 for instance 0a6a752b-46c1-419a-a67f-b438ec73dfef on hv-cinder-85061 Oct 10 12:02:50.156906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-22e787da-23ef-489c-b0fd-6044826eb9f2 req-10641b46-619f-4ae9-90b4-2c0ad6d2b784 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033004 Oct 10 12:02:50.157754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 245/487] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:50.706836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:50.707590 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:50.710014 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=49 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:50.716186 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:50.716798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:50.717330 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:50.718134 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:50.718651 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:50.719109 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:50.755022 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:50.755511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:50.755982 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:50.756438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lazy-loading 'fault' on Instance uuid 0a6a752b-46c1-419a-a67f-b438ec73dfef {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:02:50.804758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:50.813903 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8eb1c2c-6fc3-46b2-8942-8e9736e0b933 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 200 len: 1331 microversion: 2.1 time: 0.110750 Oct 10 12:02:50.814787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 243/488] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:50 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:51.839309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:51.840012 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:51.846143 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:51.846623 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:51.847084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:51.847775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:51.848227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:51.848650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:51.861848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef HTTP/1.1 Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:02:51.864150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:02:51.865754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '0a6a752b-46c1-419a-a67f-b438ec73dfef'} Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:02:51.870586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:02:51.872097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:02:51.873422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:02:51.873422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c5c103cd-e7b7-4464-81bf-6b59e24eba54 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 404 len: 111 microversion: 2.1 time: 0.031585 Oct 10 12:02:51.873422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 246/489] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:51 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:02:51.875049 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4acbf975-7f8d-40cf-b871-2793d3f19f79 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '.version_select at 0x7f862069cc10>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:51.895547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4acbf975-7f8d-40cf-b871-2793d3f19f79 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450129352" status: 202 len: 0 microversion: 2.1 time: 0.024173 Oct 10 12:02:51.896770 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 244/490] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Oct 10 12:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450129352 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:02:52.569591 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:52.570080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:52.576594 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:52.577067 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:52.577493 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:52.578166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:52.578616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:52.579071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:52.702546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lazy-loading 'services' on Instance uuid 0ddfe581-92c6-4065-9fff-7ebe3462658b {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:02:52.821653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b2fba605-efed-4d9b-9791-938d842aa404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments/978bc04e-e74f-4841-b456-33236d73f2c5" status: 202 len: 0 microversion: 2.1 time: 0.255183 Oct 10 12:02:52.822240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 247/491] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:02:52 2022] DELETE /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments/978bc04e-e74f-4841-b456-33236d73f2c5 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:02:52.831340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:52.833535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:52.840672 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:52.841157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:52.841614 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:52.842313 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:52.842768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:52.843235 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:52.872381 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fa470105-97b4-4aca-93d0-27b44b51a147 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Oct 10 12:02:52.872945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 245/492] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:02:52 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:02:53.886332 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:53.888685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:53.895504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:53.895989 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:53.896423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:53.897110 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:53.897565 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:53.897990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:53.927217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-711d0227-3ed0-4704-9e2d-aa646e7343b2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Oct 10 12:02:53.927759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 248/493] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:02:53 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:54.940039 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:54.942245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:54.949252 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:54.949745 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:54.950184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:54.950878 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:54.951682 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:54.952120 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:54.980232 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7d310c0f-50b6-40f5-b6b3-e5bff176a0ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044211 Oct 10 12:02:54.980777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 246/494] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:02:54 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:02:55.043694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:55.044184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:55.050583 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:55.051100 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:55.051804 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:55.052492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:55.052949 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:55.053375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:55.078941 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:02:55.152199 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f18965f3-5702-4310-be80-d760e049f1ad tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 204 len: 0 microversion: 2.1 time: 0.112095 Oct 10 12:02:55.152773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 249/495] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:02:55 2022] DELETE /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:02:55.163209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:55.163844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:55.170327 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:55.170816 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:55.171299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:55.171990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:55.172452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:55.172878 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:55.306283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:55.313908 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2713e788-1477-474b-9caf-9dd14cff60e9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1679 microversion: 2.1 time: 0.156803 Oct 10 12:02:55.314623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 247/496] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:55 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:56.338996 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:56.339703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:56.345973 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:56.346457 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:56.346909 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:56.347592 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:56.348043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:56.348466 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:56.475287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:56.482949 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e1813429-8194-4f43-a96c-86d7a4a1233f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1679 microversion: 2.1 time: 0.148833 Oct 10 12:02:56.483561 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 250/497] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:56 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:56.899608 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:56.900169 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:56.906473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:56.906991 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:56.907435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:56.908128 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:56.908606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:56.909019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:57.030802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lazy-loading 'services' on Instance uuid 1f2361c0-e286-45a7-a0d6-0a62221cdd27 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:02:57.140279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c6694b05-6fef-4f63-8cd7-93c9022a4c62 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-volume_attachments/1b160e43-6fd4-44a5-9993-eceec7220d23" status: 202 len: 0 microversion: 2.1 time: 0.244819 Oct 10 12:02:57.140962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 248/498] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:02:56 2022] DELETE /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-volume_attachments/1b160e43-6fd4-44a5-9993-eceec7220d23 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:02:57.506612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:57.507249 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:57.514282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:57.514763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:57.515235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:57.515955 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:57.516407 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:57.516826 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:57.650270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:57.658352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa1302ba-814e-4732-8015-d9035e298c3a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1679 microversion: 2.1 time: 0.155468 Oct 10 12:02:57.658851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 251/499] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:57 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:58.127718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:58.130108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:58.138174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.138679 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.139150 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.139852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.140311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.140743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.214317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5bb4e593-7786-4e15-b066-eba4ef333f89 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/action" status: 202 len: 0 microversion: 2.1 time: 0.091036 Oct 10 12:02:58.218231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 249/500] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:02:58 2022] POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:02:58.223605 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:58.224222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:58.230800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.231510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.231949 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.232642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.233297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.233723 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.599939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:58.604076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:58.609917 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0354d7bb-3020-4da9-b71e-a4bef6dfc8e2 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1750 microversion: 2.1 time: 0.390388 Oct 10 12:02:58.610484 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 252/501] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:58 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1750 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:58.682946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:58.683656 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:58.690545 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.691068 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.691504 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.692205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.692655 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.693077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.945656 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:58.954177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8e0434ab-8457-414e-a434-b1d454127450 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1612 microversion: 2.1 time: 0.275979 Oct 10 12:02:58.954750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 250/502] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:58 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1612 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:59.141755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-4587c94c-a567-4e90-b1ed-389953e1ed2d req-33c78af0-9198-4b8f-b04b-40a1941e849e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddfe581-92c6-4065-9fff-7ebe3462658b", "name": "network-vif-deleted", "tag": "b0a4554c-8489-4c92-b988-ba8723479120"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:59.152345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4587c94c-a567-4e90-b1ed-389953e1ed2d req-33c78af0-9198-4b8f-b04b-40a1941e849e service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.152825 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4587c94c-a567-4e90-b1ed-389953e1ed2d req-33c78af0-9198-4b8f-b04b-40a1941e849e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.153250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4587c94c-a567-4e90-b1ed-389953e1ed2d req-33c78af0-9198-4b8f-b04b-40a1941e849e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:59.166089 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-4587c94c-a567-4e90-b1ed-389953e1ed2d req-33c78af0-9198-4b8f-b04b-40a1941e849e service nova] Creating event network-vif-deleted:b0a4554c-8489-4c92-b988-ba8723479120 for instance 0ddfe581-92c6-4065-9fff-7ebe3462658b on hv-cinder-85061 Oct 10 12:02:59.172013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-4587c94c-a567-4e90-b1ed-389953e1ed2d req-33c78af0-9198-4b8f-b04b-40a1941e849e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Oct 10 12:02:59.172712 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 253/503] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:59.371675 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15cb32f3-ce61-49e6-815b-73a0ce8c9e9e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:59.378024 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15cb32f3-ce61-49e6-815b-73a0ce8c9e9e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.378512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15cb32f3-ce61-49e6-815b-73a0ce8c9e9e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.378966 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15cb32f3-ce61-49e6-815b-73a0ce8c9e9e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:59.419373 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-15cb32f3-ce61-49e6-815b-73a0ce8c9e9e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Going to try to stop instance {{(pid=120662) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 12:02:59.470336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-15cb32f3-ce61-49e6-815b-73a0ce8c9e9e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action" status: 202 len: 0 microversion: 2.1 time: 0.104198 Oct 10 12:02:59.472163 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 251/504] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:02:59 2022] POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:02:59.486342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:59.489404 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:59.505632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.506380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.507059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:59.507791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.508541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.509176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:59.634343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:59.635076 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:59.641046 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.641530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.641960 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:59.642655 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.643139 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.643558 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:59.646096 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:59.654830 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2a9edceb-7295-4ff6-bac2-fb2dbf2ecd38 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.177503 Oct 10 12:02:59.655540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 254/505] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:59 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:59.807288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:59.816089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a244022c-f182-4ee0-8de8-3c68e1c8e8cf tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1750 microversion: 2.1 time: 0.185913 Oct 10 12:02:59.816628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 252/506] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:59 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:02:59.977355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:59.978179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:59.984601 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.985092 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.985626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:59.986291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:59.986784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:59.987312 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.022414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:00.023119 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:00.023728 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.024813 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lazy-loading 'fault' on Instance uuid 0ddfe581-92c6-4065-9fff-7ebe3462658b {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:03:00.069749 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:00.078064 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cdb58ffb-2221-43e0-af02-d84d4aa0ab72 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 200 len: 1330 microversion: 2.1 time: 0.104506 Oct 10 12:03:00.078637 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 255/507] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:59 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:00.679896 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:00.680519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:00.687658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:00.688153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:00.688595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.689291 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:00.689761 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:00.690190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.816144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:00.823748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ab392ec7-c960-4965-b7ca-b7c711d423e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.148078 Oct 10 12:03:00.824323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 253/508] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:00 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:00.839769 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:00.840375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:00.846653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:00.847165 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:00.847596 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.848275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:00.848725 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:00.849148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.992931 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:01.001040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9e430f42-bcd1-4ba4-b4e1-03d485d2395e tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.165595 Oct 10 12:03:01.001586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 256/509] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:00 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:01.101634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:01.102222 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:01.108956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:01.109445 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:01.109884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:01.110579 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:01.111069 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:01.111504 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:01.125035 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b HTTP/1.1 Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:03:01.126784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:03:01.128399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '0ddfe581-92c6-4065-9fff-7ebe3462658b'} Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:03:01.129361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:03:01.130541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:01.131724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:03:01.131724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-85d0b8a5-01d4-45b1-af41-1ae35268d947 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 404 len: 111 microversion: 2.1 time: 0.030572 Oct 10 12:03:01.131724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 254/510] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:01 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:03:01.137081 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b3a963fe-90fd-423f-8903-6777f0093d30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '.version_select at 0x7f8620585160>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:01.156722 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b3a963fe-90fd-423f-8903-6777f0093d30 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575014218" status: 202 len: 0 microversion: 2.1 time: 0.023636 Oct 10 12:03:01.157276 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 257/511] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Oct 10 12:03:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575014218 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:03:01.758146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-84318893-2160-4287-9be3-9240050347fb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: .version_select at 0x7f8620653e50>, body: {"keypair": {"name": "tempest-keypair-1186027416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoopEYQL4hJin0//aNIKgTRRS1K1780IjYg5Nfgflf7mPHvh8VC3RbzMqXOoHT/kWrkBHXTLrc+Ep+4NkVm+cKYazr70mS7QMC1TPqtoN9aEY7oYpmTKeoaiLsnZ/0QZw=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:01.774397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-84318893-2160-4287-9be3-9240050347fb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:03:01.778199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-84318893-2160-4287-9be3-9240050347fb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:03:01.800068 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-84318893-2160-4287-9be3-9240050347fb tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045804 Oct 10 12:03:01.800645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 255/512] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:03:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:01.846516 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:01.847423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:01.854638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:01.855240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:01.855685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:01.856384 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:01.856929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:01.857308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:01.992267 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:02.000854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-99a02ef3-01f1-4c6f-ba47-eb4721f46b41 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.158278 Oct 10 12:03:02.001528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 258/513] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:01 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:02.024619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:02.025281 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:02.031637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:02.032136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:02.032584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:02.033291 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:02.033754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:02.034187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:02.187116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:02.199295 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1f18d947-32d4-471f-948b-a8f8ab5820c0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.175864 Oct 10 12:03:02.199295 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 256/514] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:02 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:03.023699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:03.024318 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:03.030835 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.031355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.031795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.032488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.032945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.033370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.057216 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-387221386", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05a9786c-a8d0-4fea-bd0d-744e4b7d958a"}], "security_groups": [{"name": "tempest-securitygroup--1893606719"}], "key_name": "tempest-keypair-1186027416", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:03.202734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] validate_networks() for [('05a9786c-a8d0-4fea-bd0d-744e4b7d958a', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:03:03.207103 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:03.214988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ce5c30cd-fcdf-486a-8421-f99c0489096e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.195203 Oct 10 12:03:03.215564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 259/515] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:03 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:03.219997 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:03.220598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:03.226217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.226689 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.227218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.228044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.228421 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.228892 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.435580 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:03.443670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9ef833a5-16b1-4de8-aaff-7c47fe27feec tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.227182 Oct 10 12:03:03.444227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 260/516] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:03 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:03.658707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:03:03.659167 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:03:03.659645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:03:03.660087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:03:03.660529 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:03:03.669656 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.670136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.670571 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.671332 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.671788 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.672214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.679185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:03.692215 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:03:03.696851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:03:03.708493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:03:03.710798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:03:03.758305 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-05352e23-a159-463f-8c32-c7d038652369 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.705298 Oct 10 12:03:03.759005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 257/517] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:03:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:03:03.770123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-286a5174-4ca1-4ab7-ac25-d856bccc1144 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:03.770725 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-286a5174-4ca1-4ab7-ac25-d856bccc1144 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:03.823398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-286a5174-4ca1-4ab7-ac25-d856bccc1144 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:03.830224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-286a5174-4ca1-4ab7-ac25-d856bccc1144 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1241 microversion: 2.1 time: 0.063902 Oct 10 12:03:03.830797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 261/518] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:03 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:04.238575 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:04.239258 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:04.246824 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.247627 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.248262 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.249187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.249906 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.250435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.381918 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:04.390293 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9ea3c604-1e6b-4bf1-a939-000b0b7d90ad tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.155659 Oct 10 12:03:04.390929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 258/519] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:04 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:04.466677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:04.467399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:04.474644 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.475222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.475655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.476338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.476791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.477207 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.620287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:04.628520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a0ae0dd5-96ac-4653-98da-cbf88d78f16f tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.166521 Oct 10 12:03:04.629220 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 262/520] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:04 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:04.853545 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:04.854175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:04.860168 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.860654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.861113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.861782 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.862237 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.862662 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.923115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:04.930811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e5baf48a-6ae3-4a10-a710-c95f256b8bdf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1293 microversion: 2.1 time: 0.081152 Oct 10 12:03:04.931908 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 259/521] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:04 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:05.420395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:05.421007 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:05.427291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.427993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.428424 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:05.429140 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.429781 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.430197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:05.563939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:05.571643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ae286eeb-40fd-4f09-b4dc-a0403b083a9d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.160775 Oct 10 12:03:05.572197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 263/522] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:05 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:05.652795 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:05.653482 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:05.659756 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.660234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.660668 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:05.661363 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.661824 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.662246 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:05.899578 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:05.908549 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4f8edfdc-ff5b-403f-82fe-5506fd74aafe tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.260111 Oct 10 12:03:05.909063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 260/523] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:05 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:05.953852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:05.954500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:05.960645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.961260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.961706 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:05.963008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.963511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.963943 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:06.037296 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:06.045229 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-efe29d5e-55d1-4851-a477-582d95ac9d22 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1299 microversion: 2.1 time: 0.095209 Oct 10 12:03:06.045810 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 264/524] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:05 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:06.594776 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:06.595547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:06.601288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:06.601765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:06.602206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:06.602908 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:06.603391 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:06.603816 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:06.851194 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:06.858733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0278ca3d-e0be-457c-b6e9-bbbb664132a8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.267833 Oct 10 12:03:06.859335 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 261/525] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:06 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:06.932142 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:06.932775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:06.935209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:06.940363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:06.940848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:06.941284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:06.941983 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:06.942438 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:06.942858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.048326 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-dd9b1ae9-269a-4edb-9203-70598478636a req-5292ae23-0e3d-47fc-a93b-8277d950fd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100c216f-5533-4bf3-af33-bb5c6a45017d", "tag": "693388ca-7889-4616-8a3e-a5cc8e832bc3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:07.060283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dd9b1ae9-269a-4edb-9203-70598478636a req-5292ae23-0e3d-47fc-a93b-8277d950fd32 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.060848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dd9b1ae9-269a-4edb-9203-70598478636a req-5292ae23-0e3d-47fc-a93b-8277d950fd32 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.061279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dd9b1ae9-269a-4edb-9203-70598478636a req-5292ae23-0e3d-47fc-a93b-8277d950fd32 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.073119 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-dd9b1ae9-269a-4edb-9203-70598478636a req-5292ae23-0e3d-47fc-a93b-8277d950fd32 service nova] Creating event network-changed:693388ca-7889-4616-8a3e-a5cc8e832bc3 for instance 100c216f-5533-4bf3-af33-bb5c6a45017d on hv-cinder-85061 Oct 10 12:03:07.078262 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-dd9b1ae9-269a-4edb-9203-70598478636a req-5292ae23-0e3d-47fc-a93b-8277d950fd32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033870 Oct 10 12:03:07.078865 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 262/526] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:07.084922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:07.085995 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:07.092546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.093033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.093470 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.094176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.095393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.095820 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.199956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:07.208162 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-97c23bf2-348d-4eb5-8332-2a2dee5b9aaa tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.280406 Oct 10 12:03:07.208819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 265/527] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:06 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:07.326360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:07.334658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c78d4b63-e17d-4783-9b18-8463b069067a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.254671 Oct 10 12:03:07.335260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 263/528] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:07 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:07.882877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:07.883576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:07.889545 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.890026 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.890461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.891169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.891626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.892084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:08.017714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:08.026002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b38531e8-a889-4c7f-b331-9c31a4e074f2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.146991 Oct 10 12:03:08.026568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 266/529] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:07 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:08.231251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:08.231788 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:08.238102 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:08.238580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:08.239047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:08.239725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:08.240175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:08.240595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:08.357316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:08.357927 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:08.363903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:08.364479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:08.364908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:08.365590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:08.366040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:08.366458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:08.380612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:08.389436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f2af6857-f465-4a0f-bbda-8a309e04e2a1 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.162189 Oct 10 12:03:08.389998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 264/530] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:08 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:08.495895 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:08.503493 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-82baf0dd-c97d-483c-8120-1467ee200e85 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.150080 Oct 10 12:03:08.504051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 267/531] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:08 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:09.048990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:09.049706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:09.055991 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.056668 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.057101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.057785 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.058241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.058663 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.255530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:09.263712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-216debe5-b94a-46bd-9b4f-25fff3c5e572 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.218553 Oct 10 12:03:09.264276 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 265/532] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:09 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:09.412534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:09.413223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:09.421013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.421617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.422127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.422925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.423448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.423939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.527822 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:09.528387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:09.534551 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.535075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.535516 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.536216 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.536671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.537098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.765808 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:09.770958 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:09.773461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1a033c92-fbfb-4275-9fc2-0b70d5adce9c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.250397 Oct 10 12:03:09.774224 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 266/533] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:09 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:09.779323 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d8307ea8-3522-4d33-8fc0-05d9195bf84c tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.370610 Oct 10 12:03:09.779925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 268/534] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:09 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:10.287729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:10.288374 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:10.294631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.295144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.295583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:10.296267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.296729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.297148 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:10.428674 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:10.436363 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-113a5751-cfba-4c92-be58-8dc8193e8cb1 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.152433 Oct 10 12:03:10.437142 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 267/535] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:10 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:10.796550 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:10.797188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:10.802100 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:10.802713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:10.803873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.804350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.804785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:10.805469 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.806436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.806866 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:10.809400 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.809877 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.810318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:10.811067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.811524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.811946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:11.003362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:11.010930 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-930e035e-880e-49d7-a9b9-e5d0d6bc8981 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.218196 Oct 10 12:03:11.011507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 269/536] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:10 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:11.017661 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:11.025814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-778aa3d3-5899-4aac-947c-563088debb73 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.227770 Oct 10 12:03:11.026386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 268/537] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:10 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:11.460281 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:11.460920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:11.467484 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:11.467959 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:11.468392 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:11.469072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:11.469526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:11.469944 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:11.596007 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:11.604325 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2b0578b4-03ce-4622-82c5-8df51723f2dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.148000 Oct 10 12:03:11.604957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 270/538] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:11 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:12.033668 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:12.034287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:12.041349 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.041834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.042272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.042985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.043455 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.043874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.049334 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:12.049955 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:12.057509 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.058004 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.058446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.059188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.059648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.060206 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.230708 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:12.239372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-75697919-dc1d-4e20-b949-50f9f5908ca4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.209238 Oct 10 12:03:12.254294 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 269/539] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:12 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:12.279363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:12.283044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:12.288727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-54cf79e6-8975-4a91-8ddd-fd7fbd96e2f7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.243172 Oct 10 12:03:12.289362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 271/540] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:12 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:12.641408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:12.642044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:12.647974 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.648460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.648899 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.650199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.650657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.651116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.758103 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d904a23-8af0-438b-93a8-2b70ec7cfe6c"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:12.760553 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:12.766764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.767273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.767707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.768400 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:12.768855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:12.769280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.776610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:12.784245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2b2fb4cd-6dcf-4728-8bdd-17d4ac4ca553 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.146671 Oct 10 12:03:12.784819 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 270/541] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:12 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:13.034087 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ce6c47e6-0540-46bd-a198-e9a2e2dab270 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279806 Oct 10 12:03:13.034754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 272/542] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:03:12 2022] POST /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:03:13.263715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:13.264360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:13.270680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.271213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.271657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.272350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.272808 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.273242 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.314702 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:13.315659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:13.322269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.322785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.323249 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.323945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.324403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.324829 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.453793 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:13.461402 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-53ea0062-8328-4679-82a7-e5d7a15bb52b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.202012 Oct 10 12:03:13.462775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 271/543] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:13 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:13.495559 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:13.503868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a494777e-621a-4041-8c48-b40a3e836602 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.193998 Oct 10 12:03:13.504438 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 273/544] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:13 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:13.773888 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ff0050df-6a4e-4dac-9d77-78001eb8e3ff req-05a03255-dd4a-4a57-abb3-d2dca0949034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c216f-5533-4bf3-af33-bb5c6a45017d", "name": "network-vif-plugged", "status": "completed", "tag": "693388ca-7889-4616-8a3e-a5cc8e832bc3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:13.779859 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:13.780685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=10 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:13.787306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ff0050df-6a4e-4dac-9d77-78001eb8e3ff req-05a03255-dd4a-4a57-abb3-d2dca0949034 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.787784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ff0050df-6a4e-4dac-9d77-78001eb8e3ff req-05a03255-dd4a-4a57-abb3-d2dca0949034 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.788340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ff0050df-6a4e-4dac-9d77-78001eb8e3ff req-05a03255-dd4a-4a57-abb3-d2dca0949034 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.809600 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:13.809827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:13.814348 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ff0050df-6a4e-4dac-9d77-78001eb8e3ff req-05a03255-dd4a-4a57-abb3-d2dca0949034 service nova] Creating event network-vif-plugged:693388ca-7889-4616-8a3e-a5cc8e832bc3 for instance 100c216f-5533-4bf3-af33-bb5c6a45017d on hv-cinder-85061 Oct 10 12:03:13.821135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.821633 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.822072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.823175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.823297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.823995 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.826077 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ff0050df-6a4e-4dac-9d77-78001eb8e3ff req-05a03255-dd4a-4a57-abb3-d2dca0949034 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055863 Oct 10 12:03:13.827026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 272/545] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:13.831209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:14.019153 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:14.028742 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ed9b9568-e0bf-4f9c-81ce-e34c02cd3bbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.224618 Oct 10 12:03:14.029474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 274/546] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:13 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:14.484814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:14.485519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:14.492322 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:14.492801 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:14.493746 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:14.494427 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:14.494932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:14.495357 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:14.526729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:14.527451 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:14.534094 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:14.534612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:14.535079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:14.535771 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:14.536257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:14.536682 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:14.729132 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:14.737325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d07a5a23-c3e0-4cb2-8900-f61ae4274404 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.256706 Oct 10 12:03:14.738242 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 273/547] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:14 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:14.793438 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:14.801812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-775c0f22-e1aa-4277-8a1f-0c7b716ec817 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.278931 Oct 10 12:03:14.802377 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 275/548] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:14 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:15.053094 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:15.053633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:15.060162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:15.060650 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:15.061087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:15.061773 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:15.062234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:15.062659 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:15.191728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:15.200188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1ef1742c-cb49-4fd1-b858-6a560611a5f8 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1677 microversion: 2.1 time: 0.151232 Oct 10 12:03:15.200833 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 274/549] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:15 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:15.761694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:15.762254 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:15.768919 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:15.769398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:15.769878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:15.770529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:15.771399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:15.771516 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:15.825512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:15.826308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:15.832789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:15.833269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:15.833710 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:15.834401 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:15.834851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:15.835306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:15.948484 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:15.956352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc4391f7-a59b-44cb-a746-6a45722a0283 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1367 microversion: 2.1 time: 0.198577 Oct 10 12:03:15.956929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 276/550] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:15 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:16.007185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:16.009671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:16.018111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9692a89e-1085-462f-a67c-329050e8c482 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1755 microversion: 2.1 time: 0.196451 Oct 10 12:03:16.018791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 275/551] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:15 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:16.223203 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:16.223812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:16.230346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:16.230832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:16.231295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:16.231991 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:16.232445 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:16.232867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:16.359659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:16.367369 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b07582a-8992-405a-8522-119de81341d9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1654 microversion: 2.1 time: 0.148037 Oct 10 12:03:16.367950 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 277/552] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:16 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:16.390708 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c11ad218-e6d6-451d-91f8-8b2b1751c2a0 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:16.396954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c11ad218-e6d6-451d-91f8-8b2b1751c2a0 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:16.397440 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c11ad218-e6d6-451d-91f8-8b2b1751c2a0 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:16.397876 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c11ad218-e6d6-451d-91f8-8b2b1751c2a0 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:16.420289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c11ad218-e6d6-451d-91f8-8b2b1751c2a0 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Going to try to start instance {{(pid=120662) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 12:03:16.461432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c11ad218-e6d6-451d-91f8-8b2b1751c2a0 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action" status: 202 len: 0 microversion: 2.1 time: 0.074501 Oct 10 12:03:16.462028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 276/553] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:03:16 2022] POST /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:03:16.470245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:16.470838 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:16.476668 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:16.477150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:16.478112 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:16.478795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:16.479282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:16.479704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:16.604627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:16.612197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6be7f0e4-7e15-49b1-a385-997ffff258e9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1663 microversion: 2.1 time: 0.145825 Oct 10 12:03:16.612762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 278/554] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:16 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:16.981230 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:16.981910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:16.988261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:16.988749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:16.989190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:16.989884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:16.990342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:16.990806 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:17.042167 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:17.042775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:17.049183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:17.049656 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:17.050085 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:17.050763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:17.051506 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:17.051922 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:17.168037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:17.178131 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a83d7350-ea2c-44f3-bed8-b8bbe204a811 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1557 microversion: 2.1 time: 0.201686 Oct 10 12:03:17.189556 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 277/555] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:16 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:17.202663 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:17.203299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:17.205590 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:17.211562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:17.212197 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:17.212702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:17.213466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:17.213990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:17.214488 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:17.229122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:17.237634 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24bcadf2-7c10-46fe-9354-002feb654a87 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1758 microversion: 2.1 time: 0.199695 Oct 10 12:03:17.238139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 279/556] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:17 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:17.296173 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-64d6e2f0-17b1-49db-ada7-bb401d105926 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098068 Oct 10 12:03:17.297030 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 278/557] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 12:03:17 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:03:17.635779 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:17.636380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:17.642568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:17.643090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:17.643526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:17.644219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:17.644820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:17.645303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:17.904720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:17.915741 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e113f462-4c65-4a86-976d-9c96e7dae0c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1663 microversion: 2.1 time: 0.283837 Oct 10 12:03:17.916322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 280/558] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:17 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1663 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:18.901884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-d9d82053-b305-4dea-8256-2990bfb11ca8 req-25eb0d6a-025c-42ac-8bc1-66731a7ead9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100c216f-5533-4bf3-af33-bb5c6a45017d", "tag": "693388ca-7889-4616-8a3e-a5cc8e832bc3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:18.911637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d9d82053-b305-4dea-8256-2990bfb11ca8 req-25eb0d6a-025c-42ac-8bc1-66731a7ead9a service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:18.912123 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d9d82053-b305-4dea-8256-2990bfb11ca8 req-25eb0d6a-025c-42ac-8bc1-66731a7ead9a service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:18.912570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d9d82053-b305-4dea-8256-2990bfb11ca8 req-25eb0d6a-025c-42ac-8bc1-66731a7ead9a service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:18.924856 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-d9d82053-b305-4dea-8256-2990bfb11ca8 req-25eb0d6a-025c-42ac-8bc1-66731a7ead9a service nova] Creating event network-changed:693388ca-7889-4616-8a3e-a5cc8e832bc3 for instance 100c216f-5533-4bf3-af33-bb5c6a45017d on hv-cinder-85061 Oct 10 12:03:18.931188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-d9d82053-b305-4dea-8256-2990bfb11ca8 req-25eb0d6a-025c-42ac-8bc1-66731a7ead9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034176 Oct 10 12:03:18.931713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 279/559] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:18.939309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:18.939924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:18.946285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:18.946766 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:18.947246 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:18.947937 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:18.948394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:18.948814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:19.080225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:19.088839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-26c775cd-ae6f-4c99-b96e-794058b144a2 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1663 microversion: 2.1 time: 0.153249 Oct 10 12:03:19.089491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 281/560] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:18 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:20.113338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:20.114027 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:20.121357 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:20.121843 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:20.122283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:20.123007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:20.123468 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:20.123927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:20.302775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:20.311152 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-013961b8-c0e4-4167-b4ea-1872c593ad92 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1663 microversion: 2.1 time: 0.202022 Oct 10 12:03:20.311784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 280/561] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:20 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:21.334059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:21.334667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:21.341825 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:21.342312 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:21.342745 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:21.343465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:21.343920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:21.344342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:21.474417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:21.482018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a7c40034-df0e-4e5f-8c80-17633e2b1f65 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1667 microversion: 2.1 time: 0.151867 Oct 10 12:03:21.482726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 282/562] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:21 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:21.644325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:21.646623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:21.653623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:21.654101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:21.654538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:21.655245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:21.655696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:21.656115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:21.678446 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'flavor' on Instance uuid 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:03:21.799118 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d3232ab8-ba9d-4755-ad53-f5ef9fe8970e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/action" status: 200 len: 32 microversion: 2.1 time: 0.158645 Oct 10 12:03:21.799728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 281/563] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:03:21 2022] POST /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:03:21.809430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:21.810576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:21.816801 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:21.817291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:21.817728 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:21.818424 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:21.818882 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:21.819335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:22.020074 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:22.028277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46c52ab6-f255-4dca-935e-09a9fc366059 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.222645 Oct 10 12:03:22.028887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 283/564] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:21 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:23.052676 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:23.053415 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:23.059496 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:23.059982 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:23.060449 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:23.061136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:23.061599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:23.062026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:23.196809 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:23.204949 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-008519c8-c519-4204-847c-2d9db987d933 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.157311 Oct 10 12:03:23.205510 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 282/565] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:23 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:24.228943 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:24.229549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:24.236277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:24.236753 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:24.237186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:24.237867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:24.238321 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:24.238743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:24.365720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:24.374452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-899b1e63-85b8-4867-8797-0dc02a0ebefa tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.149363 Oct 10 12:03:24.375047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 284/566] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:24 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:25.397875 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:25.398517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:25.406259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:25.407001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:25.407265 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:25.407962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:25.408418 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:25.408843 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:25.538521 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:25.546716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-67ffb70c-acf1-4420-9fd6-7bf65890d5db tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.153007 Oct 10 12:03:25.547324 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 283/567] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:25 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:26.570386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:26.571602 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:26.578035 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:26.578515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:26.578982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:26.579670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:26.580124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:26.580545 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:26.708943 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:26.717219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-73a21997-b8d8-46b8-9daf-71dea1a8973e tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.150700 Oct 10 12:03:26.717821 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 285/568] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:26 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:27.741257 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:27.741783 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:27.748292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:27.748779 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:27.749220 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:27.749931 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:27.750377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:27.750805 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:27.878494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:27.887371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-013d4596-1f34-4c08-b41f-5a46bc0a6680 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.150070 Oct 10 12:03:27.887941 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 284/569] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:27 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:28.910421 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:28.910957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:28.918010 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:28.918485 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:28.918943 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:28.919623 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:28.920074 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:28.920490 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:29.047104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:29.055482 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3947c6a2-0f95-46ec-ace2-e23a7346268d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.149161 Oct 10 12:03:29.056043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 286/570] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:28 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:30.079369 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:30.079983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:30.086294 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:30.087311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:30.087755 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:30.088448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:30.088906 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:30.089342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:30.214259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:30.222423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f0075e20-d617-478d-9e28-bbf7762e6b2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.146962 Oct 10 12:03:30.223008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 285/571] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:30 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:31.247045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:31.247649 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:31.254029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:31.254515 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:31.254979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:31.255668 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:31.256121 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:31.256546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:31.260474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:31.389063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:31.397212 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-18051070-8e76-406a-aef6-f583f177e573 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.154637 Oct 10 12:03:31.397771 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 287/572] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:31 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:32.420821 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:32.421440 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:32.428233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:32.428723 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:32.429166 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:32.429857 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:32.430822 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:32.431280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:32.556893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:32.565056 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ed37849a-d1dd-44bc-af9b-d224d41debf7 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.148109 Oct 10 12:03:32.565622 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 286/573] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:32 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:33.589774 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:33.590386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:33.596847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:33.597394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:33.597834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:33.598527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:33.599020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:33.599446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:33.732886 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:33.741080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4e7c5a06-7297-40c8-a37a-400431e430fe tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.155757 Oct 10 12:03:33.741651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 288/574] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:33 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:34.544456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:34.544993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:34.551733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.552225 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.552664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.553359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.553819 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.554242 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.582481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7d957dc2-278e-44d1-9d21-c85c77a261f7 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments/5641af2a-f161-4eb7-91b5-e6ea33698032" status: 200 len: 194 microversion: 2.20 time: 0.042032 Oct 10 12:03:34.583080 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 287/575] 10.222.0.52 () {60 vars in 1454 bytes} [Mon Oct 10 12:03:34 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments/5641af2a-f161-4eb7-91b5-e6ea33698032 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:03:34.650529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:34.651056 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:34.657568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.658001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.658440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.659190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.659646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.660067 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.738656 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lazy-loading 'services' on Instance uuid 37bc3237-f592-4db7-9f6a-294f4cea3c9a {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:03:34.764428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:34.765048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:34.770805 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.771328 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.771764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.772449 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.772912 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.773339 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.811427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bf145168-9cda-4376-9863-2c22d3e939e5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments/5641af2a-f161-4eb7-91b5-e6ea33698032" status: 202 len: 0 microversion: 2.20 time: 0.165104 Oct 10 12:03:34.812383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 289/576] 10.222.0.52 () {60 vars in 1457 bytes} [Mon Oct 10 12:03:34 2022] DELETE /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments/5641af2a-f161-4eb7-91b5-e6ea33698032 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:03:34.822235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:34.824633 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:34.832304 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.832795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.833232 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.833928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:34.834389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:34.834808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:34.866991 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dbc15826-2e76-45ad-ae21-525f96d0020a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049336 Oct 10 12:03:34.867604 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 290/577] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Oct 10 12:03:34 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:03:34.908045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:34.916945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-749f4fdf-e94b-41df-8ce5-2439099eb289 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.156274 Oct 10 12:03:34.917500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 288/578] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:34 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:35.880256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:35.882555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:35.889235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:35.889723 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:35.890171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:35.890878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:35.891364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:35.891792 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:35.921749 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd63ecef-b056-4a9d-8173-cfdecdcb8119 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045947 Oct 10 12:03:35.922322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 291/579] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Oct 10 12:03:35 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:03:35.940512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:35.941262 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:35.947731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:35.948224 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:35.948660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:35.949357 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:35.949822 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:35.950279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:36.079581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:36.088285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-aa303bc6-dcca-4fda-959a-4f33930ea31d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.151630 Oct 10 12:03:36.088849 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 289/580] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:35 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:36.934611 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:36.936769 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:36.943250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:36.943733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:36.944166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:36.944854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:36.945307 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:36.945735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:36.975761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e278ef5c-13fd-481b-a1e4-ac6c7c15f027 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045191 Oct 10 12:03:36.976308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 292/581] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Oct 10 12:03:36 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:37.040529 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:37.041036 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:37.047398 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:37.047886 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:37.048324 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:37.049020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:37.049480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:37.049910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:37.065111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:37.076673 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:03:37.111542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:37.112256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:37.114159 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=56 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:37.119428 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:37.119913 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:37.120349 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:37.121070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:37.121525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:37.121946 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:37.153613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ea2bd466-5b55-4022-9bb0-9e7c84a9a63f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 204 len: 0 microversion: 2.20 time: 0.117099 Oct 10 12:03:37.154673 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 290/582] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Oct 10 12:03:37 2022] DELETE /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 12:03:37.163704 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:37.165031 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:37.170804 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:37.171323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:37.171791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:37.172485 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:37.172934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:37.173355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:37.307169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:37.315286 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4b805ed2-a532-43d6-9efb-a148bd92aba8 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.207559 Oct 10 12:03:37.315862 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 293/583] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:37 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:37.336080 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:37.344644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:37.346090 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:37.347280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-20c18b7c-18df-4a21-b436-9221c4b3d5a4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.187840 Oct 10 12:03:37.347836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 291/584] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:37 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:38.339878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:38.340655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:38.347233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:38.347761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:38.348257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:38.349005 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:38.349546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:38.350031 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:38.373452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:38.374147 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:38.381495 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:38.382355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:38.383020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:38.383900 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:38.384566 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:38.385251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:38.544401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:38.553379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e0f72726-04a2-4401-83be-99786ae1e6cc tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.217844 Oct 10 12:03:38.553964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 294/585] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:38 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:38.567378 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:38.575443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:38.576882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:38.578028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3bb271a9-eb98-42a1-92e0-7d25e1ff7201 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.209251 Oct 10 12:03:38.578575 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 292/586] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:38 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:39.576874 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:39.577592 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:39.584174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:39.584731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:39.585174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:39.585869 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:39.586326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:39.586752 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:39.603781 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:39.604402 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:39.610525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:39.611048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:39.611589 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:39.612290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:39.612749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:39.613342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:39.861294 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:39.870223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fed1d6e8-d2fe-4814-84ac-22139004ed4f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.297190 Oct 10 12:03:39.870801 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 295/587] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:39 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:39.884453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:39.884453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:39.884683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:39.884683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a0175154-34f6-435b-8e64-c871dfe1d6fc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1723 microversion: 2.20 time: 0.282739 Oct 10 12:03:39.884683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 293/588] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:39 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:03:40.126367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-853d656d-cf86-49d0-9db6-cf9f2fafaf6c req-e7eb13f2-5943-4878-be34-7daa89826972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc3237-f592-4db7-9f6a-294f4cea3c9a", "name": "network-vif-deleted", "tag": "fa2ac855-9b1f-4330-96cc-cad641c595d3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:40.137382 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-853d656d-cf86-49d0-9db6-cf9f2fafaf6c req-e7eb13f2-5943-4878-be34-7daa89826972 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:40.138262 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-853d656d-cf86-49d0-9db6-cf9f2fafaf6c req-e7eb13f2-5943-4878-be34-7daa89826972 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:40.138694 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-853d656d-cf86-49d0-9db6-cf9f2fafaf6c req-e7eb13f2-5943-4878-be34-7daa89826972 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:40.173568 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-853d656d-cf86-49d0-9db6-cf9f2fafaf6c req-e7eb13f2-5943-4878-be34-7daa89826972 service nova] Creating event network-vif-deleted:fa2ac855-9b1f-4330-96cc-cad641c595d3 for instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a on hv-cinder-85061 Oct 10 12:03:40.179557 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-853d656d-cf86-49d0-9db6-cf9f2fafaf6c req-e7eb13f2-5943-4878-be34-7daa89826972 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056773 Oct 10 12:03:40.180741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 294/589] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:40.894066 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:40.895329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:40.904653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:40.905390 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:40.905951 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:40.906852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:40.907391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:40.907812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:40.907992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:40.908695 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:40.914977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:40.915461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:40.915893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:40.916583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:40.917042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:40.917464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:40.956814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:40.957315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:40.957752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:40.958204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lazy-loading 'fault' on Instance uuid 37bc3237-f592-4db7-9f6a-294f4cea3c9a {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:03:41.022184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:41.040781 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:41.042498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:41.043855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9a161286-65cd-49db-9ea4-5442d227eb7a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 200 len: 1371 microversion: 2.20 time: 0.140576 Oct 10 12:03:41.044883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 295/590] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:40 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:03:41.091525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:41.102802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-de1cf15e-41ba-478e-9a7c-9e2e2c106c24 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.211618 Oct 10 12:03:41.104136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 296/591] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:40 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:42.071279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:42.071931 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:42.078271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:42.078750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:42.079217 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:42.079899 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:42.080351 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:42.080775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:42.095936 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] HTTP exception thrown: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Request method failure captured: Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a HTTP/1.1 Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkKbumW7bExRvUszHULb5RaFKNQwjxyjiAWOhhQpRd29zOR54GOwm_dFXPRvgc_82bX0QDNI_fdmZklTNB2MnoNhOrzb2whrcb1LABoRNxucGupHQG3iAm1RFdNLwYQQbNnJh7qiGrfQoih-CA-AJtFM9D_1BOdIjemspTqIe4japQ Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:03:42.097540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0156957151444f94be28a65b4b018156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0156957151444f94be28a65b4b018156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}] Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: b051e414038b470691ee3e91b952a87d Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:03:42.099285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '37bc3237-f592-4db7-9f6a-294f4cea3c9a'} Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:03:42.100213 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:03:42.101728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:42.103742 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Returning 404 to user: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:03:42.103742 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9abb9066-75d0-40b7-8a6c-b9a0fecb9226 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 404 len: 111 microversion: 2.20 time: 0.031483 Oct 10 12:03:42.103742 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 296/592] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:42 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:03:42.108341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-681632a8-5b1f-4f9e-bc19-dceba05085cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '.version_select at 0x7f862045d9d0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:42.126780 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-681632a8-5b1f-4f9e-bc19-dceba05085cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108491535" status: 204 len: 0 microversion: 2.20 time: 0.022180 Oct 10 12:03:42.127505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 297/593] 10.222.0.52 () {60 vars in 1262 bytes} [Mon Oct 10 12:03:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108491535 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 12:03:42.127846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:42.128454 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:42.134371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:42.134850 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:42.135308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:42.135994 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:42.136445 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:42.136891 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:42.322089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:42.330431 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-18a76e3a-3b04-4b72-93fe-1da20f83628d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.206541 Oct 10 12:03:42.331010 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 297/594] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:42 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:42.830005 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ca0321c4-f80a-4ef3-bb8c-8c6e6c50c304 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'create', calling method: .version_select at 0x7f8620596c10>, body: {"keypair": {"name": "tempest-keypair-1856849859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZSp61Oz8NcHk7cxJVIt1KM49qhkbkkAAdNnXjHE8/nO274QC4NqzSWppPjI+tAfAmqnJZfhtskQjFMI1BbC7B9cXRauKwewOgVyPSMoc+oWnT227ZpVwKs8Ehvvyh87w=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:42.846125 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-ca0321c4-f80a-4ef3-bb8c-8c6e6c50c304 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for project 0156957151444f94be28a65b4b018156. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:03:42.849882 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-ca0321c4-f80a-4ef3-bb8c-8c6e6c50c304 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for user b051e414038b470691ee3e91b952a87d and project 0156957151444f94be28a65b4b018156. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:03:42.871450 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ca0321c4-f80a-4ef3-bb8c-8c6e6c50c304 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045312 Oct 10 12:03:42.872045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 298/595] 10.222.0.52 () {62 vars in 1200 bytes} [Mon Oct 10 12:03:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 12:03:43.356509 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:43.357180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:43.363456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:43.363948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:43.364397 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:43.365101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:43.365562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:43.365990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:43.800562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:43.808959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d4404d34-5c0d-41e7-9343-b9cbc4c7a032 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.456837 Oct 10 12:03:43.809532 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 298/596] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:43 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:44.519485 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2000062430", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7586f293-9e29-43b7-8515-0f510030ca27"}], "security_groups": [{"name": "tempest-securitygroup--352256830"}], "key_name": "tempest-keypair-1856849859", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:44.619948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] validate_networks() for [('7586f293-9e29-43b7-8515-0f510030ca27', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:03:44.834383 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:44.835044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:44.842243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:44.842729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:44.843191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:44.843879 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:44.844333 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:44.844800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:45.047655 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:45.053621 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:03:45.054118 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:03:45.054695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:03:45.055240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:03:45.055731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:03:45.056026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-440a0122-84f5-449c-897a-6aa41fd4fd2d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.225453 Oct 10 12:03:45.056602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 299/597] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:44 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:45.064868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:45.065425 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:45.065940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:45.066752 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:45.067306 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:45.067806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:45.085458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for project 0156957151444f94be28a65b4b018156. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:03:45.089906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Getting quotas for user b051e414038b470691ee3e91b952a87d and project 0156957151444f94be28a65b4b018156. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:03:45.100687 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:03:45.103038 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:03:45.150346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-deac478e-6eb6-4b05-8452-0b89adf9c622 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.635710 Oct 10 12:03:45.151177 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 299/598] 10.222.0.52 () {62 vars in 1188 bytes} [Mon Oct 10 12:03:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 12:03:45.161899 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6b806a59-cd70-4502-ac51-56f89ad92e8f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:45.162591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6b806a59-cd70-4502-ac51-56f89ad92e8f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:45.216270 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6b806a59-cd70-4502-ac51-56f89ad92e8f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:45.223379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6b806a59-cd70-4502-ac51-56f89ad92e8f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:45.224936 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6b806a59-cd70-4502-ac51-56f89ad92e8f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:45.226026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6b806a59-cd70-4502-ac51-56f89ad92e8f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1282 microversion: 2.20 time: 0.067964 Oct 10 12:03:45.226580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 300/599] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:45 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:46.080391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:46.081008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:46.087831 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:46.088319 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:46.088762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:46.089472 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:46.089931 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:46.090359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:46.221139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:46.230000 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11b33059-454e-49c9-b7e1-f758c6fa42e9 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1736 microversion: 2.1 time: 0.153998 Oct 10 12:03:46.230574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 300/600] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:46 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:46.250377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:46.251018 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:46.257440 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:46.257929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:46.258461 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:46.259168 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:46.259623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:46.260042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:46.319576 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:46.328073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:46.329705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:46.331037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e12801c9-a2e9-461d-8188-c89c367a1214 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1286 microversion: 2.20 time: 0.084392 Oct 10 12:03:46.331876 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 301/601] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:46 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:47.253586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:47.254371 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:47.261424 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.261907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.262346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.263082 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.263540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.263965 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.356685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:47.357538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:47.360331 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:47.366727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.367889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.368438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.369251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.369778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.370289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.467317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:47.477395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:47.478921 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:47.480098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0c983e9-6ca8-47a6-b48b-0abeab5f7f3c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1352 microversion: 2.20 time: 0.127818 Oct 10 12:03:47.487277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 302/602] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:47 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:03:47.520540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:47.529190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8cfac600-251a-499b-9b49-dced0bf93541 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1716 microversion: 2.1 time: 0.279536 Oct 10 12:03:47.529758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 301/603] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:47 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1716 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:47.640797 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:47.641333 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:47.647175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.647662 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.648100 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.648793 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.649249 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.649674 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.730840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] HTTP exception thrown: Cannot 'detach_volume' instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 while it is in vm_state rescued Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Request method failure captured: Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments/8d904a23-8af0-438b-93a8-2b70ec7cfe6c HTTP/1.1 Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkc6ANJAn4uWtl_9BYI0POST6SAJGl-9w8hepgSBg41ul6fod8KOQddqQkxt1Uw-ZG8vRij_xsT-LzUklmeqbM4dSCd-LTGn5cNdEAEWq0Ox0m4Yc5Ojo99W3zjXXSDMI_atXaQKn5Q67dJ5BUtLcftGHaFeozYhYayoWEXU009_tI Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:03:47.732435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b72dcfa7755e499f8f55ade0fde3d7c7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}] Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 99b3e727e6fa480c90a054a60b68b8d0 Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:03:47.734012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Cannot 'detach_volume' instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 while it is in vm_state rescued Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3', 'id': '8d904a23-8af0-438b-93a8-2b70ec7cfe6c'} Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:03:47.734798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 while it is in vm_state rescued Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 while it is in vm_state rescued Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:03:47.736261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Returning 409 to user: Cannot 'detach_volume' instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 while it is in vm_state rescued {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:03:47.738078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-75e083c4-5009-4f0e-b5ad-f7d069430263 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments/8d904a23-8af0-438b-93a8-2b70ec7cfe6c" status: 409 len: 152 microversion: 2.1 time: 0.097041 Oct 10 12:03:47.738078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 303/604] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:03:47 2022] DELETE /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments/8d904a23-8af0-438b-93a8-2b70ec7cfe6c => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 12:03:47.743463 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:47.743992 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:47.749869 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.750350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.750810 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.751689 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.752144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.752566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.819533 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a8e8ec42-3e04-4dcf-9560-0c94149770e2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "POST /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/action" status: 202 len: 0 microversion: 2.1 time: 0.080463 Oct 10 12:03:47.823652 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 302/605] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:03:47 2022] POST /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:03:47.828871 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:47.829588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:47.836404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.836990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.837883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:47.838907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:47.839655 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:47.840243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:48.165279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:48.174066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9bec34a8-787a-4da3-9fbc-09d2b82500e3 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1724 microversion: 2.1 time: 0.349053 Oct 10 12:03:48.174986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 304/606] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:47 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:48.506427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:48.507189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:48.513771 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:48.514256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:48.514694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:48.515447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:48.515905 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:48.516333 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:48.810622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:48.819464 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:48.821809 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:48.823048 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9d3c92b6-052f-4002-be64-6f1f62dfc8a5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.321557 Oct 10 12:03:48.823679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 303/607] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:48 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:49.198378 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:49.199024 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:49.205559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:49.206055 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:49.206500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:49.207246 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:49.207714 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:49.208146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:49.411070 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:49.422944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4fb2202a-a9ab-4f7c-8fe1-b98e1281cde2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1724 microversion: 2.1 time: 0.229076 Oct 10 12:03:49.423527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 305/608] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:49 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:49.547774 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-953109c4-be82-4b75-89bf-64b89d416367 req-252f3a80-f92f-48a5-8f01-c2e6559ecc9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e69a02d-e65e-499c-b917-0848603db0b7", "tag": "78c57fac-0497-4b6c-9eae-773ed6db62fe"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:49.559012 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-953109c4-be82-4b75-89bf-64b89d416367 req-252f3a80-f92f-48a5-8f01-c2e6559ecc9f service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:49.559495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-953109c4-be82-4b75-89bf-64b89d416367 req-252f3a80-f92f-48a5-8f01-c2e6559ecc9f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:49.559925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-953109c4-be82-4b75-89bf-64b89d416367 req-252f3a80-f92f-48a5-8f01-c2e6559ecc9f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:49.570572 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-953109c4-be82-4b75-89bf-64b89d416367 req-252f3a80-f92f-48a5-8f01-c2e6559ecc9f service nova] Creating event network-changed:78c57fac-0497-4b6c-9eae-773ed6db62fe for instance 1e69a02d-e65e-499c-b917-0848603db0b7 on hv-cinder-85061 Oct 10 12:03:49.575241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-953109c4-be82-4b75-89bf-64b89d416367 req-252f3a80-f92f-48a5-8f01-c2e6559ecc9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031141 Oct 10 12:03:49.575832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 304/609] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:49.849369 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:49.849980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:49.855946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:49.856428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:49.856867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:49.857549 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:49.858004 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:49.858430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:49.988063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:49.997346 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:49.998798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:49.999929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-19ed46d7-d1d7-4b65-add7-c8b40efe7dd4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.154513 Oct 10 12:03:50.000492 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 306/610] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:49 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:50.448817 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:50.449520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:50.455685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:50.456172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:50.456610 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:50.457304 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:50.457764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:50.458195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:50.475425 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:50.585929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:50.593966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fa7ac836-30c0-4ea8-b242-2a54254d82c4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1724 microversion: 2.1 time: 0.150120 Oct 10 12:03:50.594536 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 305/611] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:50 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:51.025538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:51.026150 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:51.032479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:51.032958 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:51.033389 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:51.034072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:51.034525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:51.034978 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:51.049686 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:51.162244 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:51.170236 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:51.171753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:51.172860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2b7a4d92-ca30-4302-9669-61fb0edfa6ca tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.151961 Oct 10 12:03:51.173417 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 307/612] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:51 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:51.617994 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:51.618628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:51.625291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:51.625789 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:51.626242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:51.626950 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:51.627405 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:51.627876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:51.809791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:51.818102 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-43377e34-d2f8-4abc-9b99-71477bea5668 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1730 microversion: 2.1 time: 0.204708 Oct 10 12:03:51.818674 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 306/613] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:51 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:51.841034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:51.841534 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:51.847651 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:51.848143 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:51.848592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:51.849287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:51.849752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:51.850178 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:51.945505 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f32e81d3-561d-40ec-8902-4fd05a092d88 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108193 Oct 10 12:03:51.946182 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 308/614] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 12:03:51 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:03:52.201170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:52.201934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:52.208129 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:52.208728 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:52.209270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:52.210180 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:52.210642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:52.211126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:52.371571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:52.380053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:52.381497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:52.382635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-863157f2-3d0c-42d0-b60d-746c34a86bc1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.188204 Oct 10 12:03:52.383435 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 307/615] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:52 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:53.010372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-1b73c88f-9837-4a29-85c0-fbd9df70b218 req-0fa08c7f-2264-49cd-bb45-7a492c86e6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3", "tag": "45df0c70-afe6-4d06-b061-e7e825e93be9"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:53.020240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1b73c88f-9837-4a29-85c0-fbd9df70b218 req-0fa08c7f-2264-49cd-bb45-7a492c86e6d1 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:53.020753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1b73c88f-9837-4a29-85c0-fbd9df70b218 req-0fa08c7f-2264-49cd-bb45-7a492c86e6d1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:53.021206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1b73c88f-9837-4a29-85c0-fbd9df70b218 req-0fa08c7f-2264-49cd-bb45-7a492c86e6d1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:53.033033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-1b73c88f-9837-4a29-85c0-fbd9df70b218 req-0fa08c7f-2264-49cd-bb45-7a492c86e6d1 service nova] Creating event network-changed:45df0c70-afe6-4d06-b061-e7e825e93be9 for instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 on hv-cinder-85061 Oct 10 12:03:53.037993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-1b73c88f-9837-4a29-85c0-fbd9df70b218 req-0fa08c7f-2264-49cd-bb45-7a492c86e6d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032493 Oct 10 12:03:53.038592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 309/616] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:53.407247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:53.407930 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:53.419700 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:53.420342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:53.420770 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:53.421462 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:53.421913 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:53.422334 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:53.644460 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:53.652927 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:53.654476 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:53.655800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3bf745b9-f94d-478f-b036-55a6005d9e49 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.252679 Oct 10 12:03:53.656582 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 308/617] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:53 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:54.681491 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:54.682117 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:54.688294 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:54.688778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:54.689215 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:54.689902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:54.690361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:54.690790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:54.819754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:54.828368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:54.829807 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:54.830926 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-68271c94-e32f-49c2-98c5-2ab488f728bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.154298 Oct 10 12:03:54.831488 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 310/618] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:54 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:55.052635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-ef5075a2-ad50-4a7c-aa9a-c88207928610 req-fe031722-72a3-4982-b38a-248153def64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3", "tag": "45df0c70-afe6-4d06-b061-e7e825e93be9"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:55.062814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ef5075a2-ad50-4a7c-aa9a-c88207928610 req-fe031722-72a3-4982-b38a-248153def64f service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:55.063393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ef5075a2-ad50-4a7c-aa9a-c88207928610 req-fe031722-72a3-4982-b38a-248153def64f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:55.063824 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ef5075a2-ad50-4a7c-aa9a-c88207928610 req-fe031722-72a3-4982-b38a-248153def64f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:55.075338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-ef5075a2-ad50-4a7c-aa9a-c88207928610 req-fe031722-72a3-4982-b38a-248153def64f service nova] Creating event network-changed:45df0c70-afe6-4d06-b061-e7e825e93be9 for instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 on hv-cinder-85061 Oct 10 12:03:55.078725 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:55.080574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-ef5075a2-ad50-4a7c-aa9a-c88207928610 req-fe031722-72a3-4982-b38a-248153def64f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031850 Oct 10 12:03:55.081169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 309/619] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:55.856681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:55.857366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:55.859494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:55.865902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:55.866395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:55.866836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:55.867577 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:55.868039 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:55.868639 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:55.997586 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:56.005574 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:56.007048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:56.008777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-85f4062d-44eb-4918-ae96-fedcc0d4e627 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.156029 Oct 10 12:03:56.009338 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 311/620] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:55 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:57.031235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=10 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:57.036344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:57.037032 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:57.043739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:57.044213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:57.044642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:57.045316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:57.045763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:57.046176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:57.175231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:57.183595 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:57.185025 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:57.186109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-94886398-f0ca-4f4e-a67b-fa14e2e20f68 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.155712 Oct 10 12:03:57.186675 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 310/621] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:57 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:57.953767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-9dbf4333-e2b4-400a-9a25-d3f0af9e1513 req-427d5bd1-c37f-4dd7-9f1a-8de51c7b16da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e69a02d-e65e-499c-b917-0848603db0b7", "name": "network-vif-plugged", "status": "completed", "tag": "78c57fac-0497-4b6c-9eae-773ed6db62fe"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:57.964559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-9dbf4333-e2b4-400a-9a25-d3f0af9e1513 req-427d5bd1-c37f-4dd7-9f1a-8de51c7b16da service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:57.965044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-9dbf4333-e2b4-400a-9a25-d3f0af9e1513 req-427d5bd1-c37f-4dd7-9f1a-8de51c7b16da service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:57.965474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-9dbf4333-e2b4-400a-9a25-d3f0af9e1513 req-427d5bd1-c37f-4dd7-9f1a-8de51c7b16da service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:57.978956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-9dbf4333-e2b4-400a-9a25-d3f0af9e1513 req-427d5bd1-c37f-4dd7-9f1a-8de51c7b16da service nova] Creating event network-vif-plugged:78c57fac-0497-4b6c-9eae-773ed6db62fe for instance 1e69a02d-e65e-499c-b917-0848603db0b7 on hv-cinder-85061 Oct 10 12:03:57.983667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-9dbf4333-e2b4-400a-9a25-d3f0af9e1513 req-427d5bd1-c37f-4dd7-9f1a-8de51c7b16da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033502 Oct 10 12:03:57.984272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 312/622] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:58.211208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:58.212394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:58.218735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:58.219255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:58.219689 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:58.220394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:58.220851 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:58.221270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:58.351828 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:58.359910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:58.361345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:58.362437 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ea639d03-37b1-44b8-90e0-5a744982e24f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.155296 Oct 10 12:03:58.363023 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 311/623] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:58 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:03:59.387082 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:59.387785 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:59.393864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:59.394374 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:59.394807 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:59.395510 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:59.395959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:59.396377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:59.526991 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:59.535103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:59.536550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:59.537690 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8b59e444-9231-488c-917c-694add21b13f tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1407 microversion: 2.20 time: 0.155330 Oct 10 12:03:59.538251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 313/624] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:03:59 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:04:00.464362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-199775291"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:00.464910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:00.471242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:00.471715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:00.472143 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:00.472819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:00.473266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:00.473684 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:00.569672 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:00.570197 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:00.576089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:00.576584 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:00.577022 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:00.577719 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:00.578175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:00.578602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:00.596688 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.network.security_group_api [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Removing security group b804ceeb-3ba4-4d3b-b277-58ea18d49ef8 from port 8350774c-a156-46d0-bb3c-69064aad8304 Oct 10 12:04:00.795076 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:00.803435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:00.804892 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:00.806716 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-117fac57-a360-4845-a0e8-beb0fabf1e1c tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1599 microversion: 2.20 time: 0.241623 Oct 10 12:04:00.807316 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 314/625] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:04:00 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1599 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:04:00.831715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:00.832241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:00.838698 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:00.839730 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:00.839855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:00.840492 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:00.840986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:00.841458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:00.949846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dc7ee430-951d-4d9c-bbd1-2371294101e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.121974 Oct 10 12:04:00.950448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 315/626] 10.222.0.52 () {60 vars in 1316 bytes} [Mon Oct 10 12:04:00 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:04:01.022184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d1a09d37-95e9-4369-9772-b1e608d72dbd tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/action" status: 202 len: 0 microversion: 2.1 time: 0.561696 Oct 10 12:04:01.026236 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 312/627] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:04:00 2022] POST /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:01.050133 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-8648e63f-51f0-41a5-b501-ed357b4a5f82 req-79443305-5395-4f51-a370-c765a1a2d377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfd5ad5-1c5f-46b8-9db7-189214d74a56", "tag": "8350774c-a156-46d0-bb3c-69064aad8304"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:01.063604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8648e63f-51f0-41a5-b501-ed357b4a5f82 req-79443305-5395-4f51-a370-c765a1a2d377 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:01.064103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8648e63f-51f0-41a5-b501-ed357b4a5f82 req-79443305-5395-4f51-a370-c765a1a2d377 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:01.064543 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8648e63f-51f0-41a5-b501-ed357b4a5f82 req-79443305-5395-4f51-a370-c765a1a2d377 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:01.086670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-8648e63f-51f0-41a5-b501-ed357b4a5f82 req-79443305-5395-4f51-a370-c765a1a2d377 service nova] Creating event network-changed:8350774c-a156-46d0-bb3c-69064aad8304 for instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 on hv-cinder-85061 Oct 10 12:04:01.092466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-8648e63f-51f0-41a5-b501-ed357b4a5f82 req-79443305-5395-4f51-a370-c765a1a2d377 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045936 Oct 10 12:04:01.093886 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 316/628] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:02.036694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-1c98e85a-617f-405c-9189-e83986f32112 req-1bb8793c-8f8a-409e-a47e-4c54b4f7e692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e69a02d-e65e-499c-b917-0848603db0b7", "tag": "78c57fac-0497-4b6c-9eae-773ed6db62fe"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:02.048592 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1c98e85a-617f-405c-9189-e83986f32112 req-1bb8793c-8f8a-409e-a47e-4c54b4f7e692 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:02.049558 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1c98e85a-617f-405c-9189-e83986f32112 req-1bb8793c-8f8a-409e-a47e-4c54b4f7e692 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:02.050620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1c98e85a-617f-405c-9189-e83986f32112 req-1bb8793c-8f8a-409e-a47e-4c54b4f7e692 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:02.066097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-1c98e85a-617f-405c-9189-e83986f32112 req-1bb8793c-8f8a-409e-a47e-4c54b4f7e692 service nova] Creating event network-changed:78c57fac-0497-4b6c-9eae-773ed6db62fe for instance 1e69a02d-e65e-499c-b917-0848603db0b7 on hv-cinder-85061 Oct 10 12:04:02.072188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-1c98e85a-617f-405c-9189-e83986f32112 req-1bb8793c-8f8a-409e-a47e-4c54b4f7e692 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039810 Oct 10 12:04:02.073043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 313/629] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:02.806696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:02.807379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:02.814166 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:02.814667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:02.815172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:02.816159 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:02.816633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:02.817062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:02.915796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lazy-loading 'services' on Instance uuid ddfd5ad5-1c5f-46b8-9db7-189214d74a56 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:02.997733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-75072973-ea1b-4f61-8d54-7062486c2e66 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments/843f8475-f313-423f-97f5-9bdc44586a7e" status: 202 len: 0 microversion: 2.1 time: 0.194978 Oct 10 12:04:02.998604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 317/630] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:04:02 2022] DELETE /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments/843f8475-f313-423f-97f5-9bdc44586a7e => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:03.007761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:03.010570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:03.016968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.017457 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.017887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.018578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.019058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.026525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.068282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4090b4cf-3bd8-4715-baa4-02ebc40d1511 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064714 Oct 10 12:04:03.069212 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 314/631] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:03 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:03.109255 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-08af0bba-2231-4d2b-95fe-701de12f3253 req-19512ebc-77ff-40fe-86cd-d4ae4d48a08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfd5ad5-1c5f-46b8-9db7-189214d74a56", "tag": "8350774c-a156-46d0-bb3c-69064aad8304"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:03.121618 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-08af0bba-2231-4d2b-95fe-701de12f3253 req-19512ebc-77ff-40fe-86cd-d4ae4d48a08b service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.122466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-08af0bba-2231-4d2b-95fe-701de12f3253 req-19512ebc-77ff-40fe-86cd-d4ae4d48a08b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.123149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-08af0bba-2231-4d2b-95fe-701de12f3253 req-19512ebc-77ff-40fe-86cd-d4ae4d48a08b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.137200 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-08af0bba-2231-4d2b-95fe-701de12f3253 req-19512ebc-77ff-40fe-86cd-d4ae4d48a08b service nova] Creating event network-changed:8350774c-a156-46d0-bb3c-69064aad8304 for instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 on hv-cinder-85061 Oct 10 12:04:03.143119 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-08af0bba-2231-4d2b-95fe-701de12f3253 req-19512ebc-77ff-40fe-86cd-d4ae4d48a08b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037537 Oct 10 12:04:03.144627 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 318/632] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:03.381859 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:03.382505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:03.388617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.389167 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.389606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.390295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.390745 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.391198 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.415449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6d4e0328-b753-4d3f-801f-389c92762845 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/ips" status: 200 len: 150 microversion: 2.1 time: 0.036762 Oct 10 12:04:03.422567 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 315/633] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:04:03 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:03.486331 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:03.488730 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:03.494925 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.495474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.495923 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.496705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.497089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.497523 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.529456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4f791fa4-c9a3-47f8-8071-79af1ce0a0dc tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047302 Oct 10 12:04:03.530219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 319/634] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:03 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:04:03.607903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:03.608679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:03.615007 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.615766 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.616407 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.617308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.618004 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.618434 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.667597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:04:03.836702 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-62b0e507-674b-41b7-b11d-968366faae13 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 204 len: 0 microversion: 2.1 time: 0.232729 Oct 10 12:04:03.838132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 316/635] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:04:03 2022] DELETE /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:04:03.847518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:03.848446 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:03.860701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.861079 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.861516 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:03.862452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:03.863103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:03.863690 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:04.082283 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:04.084645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:04.091075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:04.091640 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:04.092149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:04.092916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:04.093449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:04.093947 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:04.115954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:04.125258 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-235e0ec7-65ba-4e7d-a64b-517ff587ec4a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Oct 10 12:04:04.125802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 317/636] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:04 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:04:04.130072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f98476e8-3117-43d6-aef3-ef3bd769b2d3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1673 microversion: 2.1 time: 0.284095 Oct 10 12:04:04.135038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 320/637] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:03 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1673 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:04.847151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "748aa68d-8e09-40b9-8457-8e9e52b0c80e"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:04.849481 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:04.855486 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:04.855963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:04.856398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:04.857088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:04.857652 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:04.858148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:05.137628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:05.139853 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:05.146243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:05.146721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:05.147188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:05.147873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:05.148319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:05.148734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:05.177773 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8c3f799d-5d93-4dd3-bc2f-24035809b425 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Oct 10 12:04:05.178325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 321/638] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:05 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:04:05.183364 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:05.183986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:05.189260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:05.189729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:05.190157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:05.190830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:05.191316 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:05.191734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:05.320312 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:05.328118 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-96eeb4f4-6eeb-444f-902c-2ced9f667a3b tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1673 microversion: 2.1 time: 0.148848 Oct 10 12:04:05.328691 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 322/639] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:05 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:06.192713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:06.194902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:06.202865 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:06.203392 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:06.203835 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:06.204535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:06.205021 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:06.205451 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:06.238267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e56a5f74-a2df-4e16-84e1-35381dbbd233 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050941 Oct 10 12:04:06.238844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 323/640] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:06 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 12:04:06.250110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:06.250590 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:06.256342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:06.256834 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:06.257269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:06.257959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:06.258441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:06.258867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:06.297498 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4c9d13af-4c4f-49d6-ad9e-9a9e68838951 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.454181 Oct 10 12:04:06.298426 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 318/641] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:04:04 2022] POST /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments => generated 194 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:06.351001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] HTTP exception thrown: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 is not attached to volume 843f8475-f313-423f-97f5-9bdc44586a7e Oct 10 12:04:06.353510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:06.354736 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Request method failure captured: Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments/843f8475-f313-423f-97f5-9bdc44586a7e HTTP/1.1 Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAl-J40RCrhhCYawQlumiO20-elnZbDNUixL2LckNeA8F7IJfpPthwZxqdT8cyaoXy5u7QU8MStF-znWvIM1lH_y2sTD0eiB37Nibv0HJSVPEpDVo8Q4M1KBxuujnPhOg9Iapp7VbMdbZ4IVpaT0g7nnlTlPiXu-GwipNyXCmdEjUTM Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: f2e5245da9a24e679c6e19089e9aa199 Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestMinimumBasicScenario-1247048495 Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:04:06.355725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2e5245da9a24e679c6e19089e9aa199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f2e5245da9a24e679c6e19089e9aa199", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f2e5245da9a24e679c6e19089e9aa199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2e5245da9a24e679c6e19089e9aa199"}]}] Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestMinimumBasicScenario-1247048495 Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: f2e5245da9a24e679c6e19089e9aa199 Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1247048495 Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-TestMinimumBasicScenario-1247048495-project Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 0b2c9c8c10ec455f85cd95a813692de5 Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestMinimumBasicScenario-1247048495-project Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:04:06.357393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 is not attached to volume 843f8475-f313-423f-97f5-9bdc44586a7e Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'server_id': 'ddfd5ad5-1c5f-46b8-9db7-189214d74a56', 'id': '843f8475-f313-423f-97f5-9bdc44586a7e'} Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 843f8475-f313-423f-97f5-9bdc44586a7e. Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:06.358285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 is not attached to volume 843f8475-f313-423f-97f5-9bdc44586a7e Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 is not attached to volume 843f8475-f313-423f-97f5-9bdc44586a7e Oct 10 12:04:06.360099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:06.361731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Returning 404 to user: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 is not attached to volume 843f8475-f313-423f-97f5-9bdc44586a7e {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:06.362952 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-06e432af-7ef7-412e-b1fb-41c6af7851c7 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments/843f8475-f313-423f-97f5-9bdc44586a7e" status: 404 len: 154 microversion: 2.1 time: 0.117166 Oct 10 12:04:06.363979 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 324/642] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:04:06 2022] DELETE /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56/os-volume_attachments/843f8475-f313-423f-97f5-9bdc44586a7e => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:04:06.394954 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:06.395754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:06.396231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:06.396931 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:06.397394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:06.397826 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:06.697163 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:06.705083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-93d18b5a-8b0d-4299-adaa-e9d3b723c7dd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1673 microversion: 2.1 time: 0.357130 Oct 10 12:04:06.705635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 319/643] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:06 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1673 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:07.538373 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:07.538936 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:07.546165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:07.546657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:07.547120 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:07.548231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:07.548852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:07.549497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:07.581191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:04:07.615403 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:07.670846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-139fea27-e1c9-46f5-993a-357a7a1adf09 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 204 len: 0 microversion: 2.1 time: 0.136201 Oct 10 12:04:07.672123 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 325/644] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:04:07 2022] DELETE /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:04:07.677710 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-6b91accf-04cd-46b0-8fc9-58eb3153cf8f req-6bfb29bc-a6d1-4191-bf72-e34d8c358445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2361c0-e286-45a7-a0d6-0a62221cdd27", "name": "network-vif-deleted", "tag": "6800ab16-3bab-4f54-bff2-7a9c18dfc7b7"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:07.681591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:07.682302 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:07.685385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:07.688540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:07.689286 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:07.689724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:07.690604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:07.691144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:07.691544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:07.706542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6b91accf-04cd-46b0-8fc9-58eb3153cf8f req-6bfb29bc-a6d1-4191-bf72-e34d8c358445 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:07.707493 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6b91accf-04cd-46b0-8fc9-58eb3153cf8f req-6bfb29bc-a6d1-4191-bf72-e34d8c358445 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:07.708154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6b91accf-04cd-46b0-8fc9-58eb3153cf8f req-6bfb29bc-a6d1-4191-bf72-e34d8c358445 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:07.724795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-6b91accf-04cd-46b0-8fc9-58eb3153cf8f req-6bfb29bc-a6d1-4191-bf72-e34d8c358445 service nova] Creating event network-vif-deleted:6800ab16-3bab-4f54-bff2-7a9c18dfc7b7 for instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 on hv-cinder-85061 Oct 10 12:04:07.735272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-6b91accf-04cd-46b0-8fc9-58eb3153cf8f req-6bfb29bc-a6d1-4191-bf72-e34d8c358445 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069209 Oct 10 12:04:07.736135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 320/645] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:07.742478 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:07.743412 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:07.750845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:07.751398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:07.751879 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:07.752632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:07.753093 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:07.753517 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:07.837202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:07.841240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:07.846236 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-edb613a0-9d2f-48e5-bb8a-0ce90307c849 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1322 microversion: 2.1 time: 0.108798 Oct 10 12:04:07.853501 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 321/646] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:07 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1322 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:07.854351 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:07.862195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-85469393-5752-4ed4-8168-c10256141ef4 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1554 microversion: 2.1 time: 0.185372 Oct 10 12:04:07.862768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 326/647] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:07 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:08.870876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:08.871437 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:08.879107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:08.879918 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:08.880355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:08.881048 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:08.881500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:08.881917 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:08.885036 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:08.885664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:08.892606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:08.893094 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:08.893530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:08.894221 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:08.894677 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:08.895125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:08.956092 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:08.963794 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b1149429-913c-45e5-a129-86c1df3a815e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1322 microversion: 2.1 time: 0.097792 Oct 10 12:04:08.964364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 322/648] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:08 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:09.038796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:09.046399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3ba379d7-59e6-404a-9343-2ea0282da868 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1554 microversion: 2.1 time: 0.165332 Oct 10 12:04:09.046982 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 327/649] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:08 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:09.986217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:09.987135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:09.994588 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:09.995099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:09.995531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:09.996224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:09.996748 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:09.997300 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:10.029776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:10.030513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:10.031003 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:10.031444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lazy-loading 'fault' on Instance uuid 1f2361c0-e286-45a7-a0d6-0a62221cdd27 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:10.069582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:10.070202 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:10.076637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:10.077130 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:10.077567 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:10.078271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:10.078718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:10.079171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:10.105461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:10.113359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c47b5f46-3d2a-4a46-ac1a-0d5a5a26f626 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 200 len: 1327 microversion: 2.1 time: 0.130945 Oct 10 12:04:10.113936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 323/650] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:09 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:10.262591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2c9c8c10ec455f85cd95a813692de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e5245da9a24e679c6e19089e9aa199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:10.272828 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0b0f06f-cb56-4bd3-bc1c-a49265b262f0 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 200 len: 1554 microversion: 2.1 time: 0.206131 Oct 10 12:04:10.273422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 328/651] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:10 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:10.358059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-298c12df-9250-49c9-aaac-c56c126b4019 req-7a323233-3023-4c60-aa00-191f71a3eb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfd5ad5-1c5f-46b8-9db7-189214d74a56", "name": "network-vif-deleted", "tag": "8350774c-a156-46d0-bb3c-69064aad8304"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:10.369970 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-298c12df-9250-49c9-aaac-c56c126b4019 req-7a323233-3023-4c60-aa00-191f71a3eb62 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:10.370441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-298c12df-9250-49c9-aaac-c56c126b4019 req-7a323233-3023-4c60-aa00-191f71a3eb62 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:10.372034 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-298c12df-9250-49c9-aaac-c56c126b4019 req-7a323233-3023-4c60-aa00-191f71a3eb62 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:10.386396 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-298c12df-9250-49c9-aaac-c56c126b4019 req-7a323233-3023-4c60-aa00-191f71a3eb62 service nova] Creating event network-vif-deleted:8350774c-a156-46d0-bb3c-69064aad8304 for instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 on hv-cinder-85061 Oct 10 12:04:10.392403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-298c12df-9250-49c9-aaac-c56c126b4019 req-7a323233-3023-4c60-aa00-191f71a3eb62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038483 Oct 10 12:04:10.393174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 324/652] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:11.135990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:11.136707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:11.144090 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:11.145078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:11.145708 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:11.146755 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:11.147261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:11.147754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:11.164099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] HTTP exception thrown: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Request method failure captured: Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 HTTP/1.1 Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkYggKzXXAk8s2ortDGbjFjn7f7pZtctMXoY0WgpVBrTJqyAeqZpnoDw1gfjoa_kOXc-q4b02IVoPkXLWCvgq-WkA7hOjIOQk9rOtQGmRxhy-cIs5Ao-0HRJ3w0TF6nckzrct5J7s1H2RUTfEvtVbgDazDC4HeiNVOqn7dfj-qh3q0 Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:04:11.166648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79aee39298624f99b33b9808fe5030f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}] Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 0c0f1d116c004694b33b19d988ac4959 Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:04:11.168162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '1f2361c0-e286-45a7-a0d6-0a62221cdd27'} Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:11.172393 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:04:11.173678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.174786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Returning 404 to user: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:11.174786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-005367a1-d498-46c4-aab7-738800316c21 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 404 len: 111 microversion: 2.1 time: 0.036415 Oct 10 12:04:11.174786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 329/653] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:11 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:04:11.178243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0857b7c5-8335-4ac7-bc26-606ba571a222 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '.version_select at 0x7f86205f3160>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:11.197254 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0857b7c5-8335-4ac7-bc26-606ba571a222 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200324675" status: 202 len: 0 microversion: 2.1 time: 0.023625 Oct 10 12:04:11.197815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 325/654] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Oct 10 12:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200324675 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:11.297620 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:11.298168 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] [instance: ddfd5ad5-1c5f-46b8-9db7-189214d74a56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:11.304367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:11.304860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:11.305901 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:11.306600 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:11.307224 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:11.307664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:11.321019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] HTTP exception thrown: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 could not be found. Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Request method failure captured: Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 HTTP/1.1 Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAl-J40RCrhhCYawQlumiO20-elnZbDNUixL2LckNeA8F7IJfpPthwZxqdT8cyaoXy5u7QU8MStF-znWvIM1lH_y2sTD0eiB37Nibv0HJSVPEpDVo8Q4M1KBxuujnPhOg9Iapp7VbMdbZ4IVpaT0g7nnlTlPiXu-GwipNyXCmdEjUTM Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: f2e5245da9a24e679c6e19089e9aa199 Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestMinimumBasicScenario-1247048495 Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:04:11.322561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2e5245da9a24e679c6e19089e9aa199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f2e5245da9a24e679c6e19089e9aa199", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f2e5245da9a24e679c6e19089e9aa199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2e5245da9a24e679c6e19089e9aa199"}]}] Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestMinimumBasicScenario-1247048495 Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: f2e5245da9a24e679c6e19089e9aa199 Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1247048495 Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-TestMinimumBasicScenario-1247048495-project Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 0b2c9c8c10ec455f85cd95a813692de5 Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestMinimumBasicScenario-1247048495-project Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 could not be found. Oct 10 12:04:11.324506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': 'ddfd5ad5-1c5f-46b8-9db7-189214d74a56'} Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 could not be found. Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:11.325394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 could not be found. Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 could not be found. Oct 10 12:04:11.326766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:11.328303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Returning 404 to user: Instance ddfd5ad5-1c5f-46b8-9db7-189214d74a56 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:11.328303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c8a7c59c-7688-4c28-a37c-4775a2cc1565 tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56" status: 404 len: 111 microversion: 2.1 time: 0.030442 Oct 10 12:04:11.328303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 330/655] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:11 2022] GET /compute/v2.1/servers/ddfd5ad5-1c5f-46b8-9db7-189214d74a56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:04:11.332905 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-07f1ff34-bdaf-4060-b981-da101fa98e0a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] Calling method '.version_select at 0x7f862045d9d0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:11.357734 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-07f1ff34-bdaf-4060-b981-da101fa98e0a tempest-TestMinimumBasicScenario-1247048495 tempest-TestMinimumBasicScenario-1247048495-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1854148940" status: 202 len: 0 microversion: 2.1 time: 0.028570 Oct 10 12:04:11.358327 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 326/656] 10.222.0.52 () {58 vars in 1272 bytes} [Mon Oct 10 12:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1854148940 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:11.852353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-69e4e4a3-a02b-4f8c-a52e-f044db7aa869 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'create', calling method: .version_select at 0x7f862066ad30>, body: {"keypair": {"name": "tempest-keypair-912878582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmU1jDqkjIKCM8tHVflRXKh+SYciflKokhTPGuUYFsL7iFGgvIgiyMepNIJaXKD3LJ7ceunOjkh1wNORMN6ALBGCkGg8UJHzgoejGdRF/PkAYp4frNpjQkakkVu9WvGIQ=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:11.869530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-69e4e4a3-a02b-4f8c-a52e-f044db7aa869 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for project 79aee39298624f99b33b9808fe5030f8. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:04:11.873694 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-69e4e4a3-a02b-4f8c-a52e-f044db7aa869 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for user 0c0f1d116c004694b33b19d988ac4959 and project 79aee39298624f99b33b9808fe5030f8. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:04:11.895703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-69e4e4a3-a02b-4f8c-a52e-f044db7aa869 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047716 Oct 10 12:04:11.896570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 331/657] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:04:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:13.860644 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1652734627", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c924414-a382-471c-a40e-c6f3cc3eb62c"}], "security_groups": [{"name": "tempest-securitygroup--1939954601"}], "key_name": "tempest-keypair-912878582", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:13.984239 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "748aa68d-8e09-40b9-8457-8e9e52b0c80e"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:13.985593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] validate_networks() for [('5c924414-a382-471c-a40e-c6f3cc3eb62c', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:04:13.987187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:13.994530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:13.995818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:13.996368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:13.997216 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:13.997836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:13.998492 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:14.154911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Invalid volume: volume 748aa68d-8e09-40b9-8457-8e9e52b0c80e is already attached to instances: 100c216f-5533-4bf3-af33-bb5c6a45017d Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments HTTP/1.1 Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 74 Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:04:14.156536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {"volumeAttachment": {"volumeId": "748aa68d-8e09-40b9-8457-8e9e52b0c80e"}} Oct 10 12:04:14.158171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Invalid volume: volume 748aa68d-8e09-40b9-8457-8e9e52b0c80e is already attached to instances: 100c216f-5533-4bf3-af33-bb5c6a45017d Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '100c216f-5533-4bf3-af33-bb5c6a45017d', 'body': {'volumeAttachment': {'volumeId': '748aa68d-8e09-40b9-8457-8e9e52b0c80e'}}} Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 748aa68d-8e09-40b9-8457-8e9e52b0c80e is already attached to instances: 100c216f-5533-4bf3-af33-bb5c6a45017d Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:14.159006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 748aa68d-8e09-40b9-8457-8e9e52b0c80e is already attached to instances: 100c216f-5533-4bf3-af33-bb5c6a45017d Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:14.160180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 748aa68d-8e09-40b9-8457-8e9e52b0c80e is already attached to instances: 100c216f-5533-4bf3-af33-bb5c6a45017d Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 400 to user: Invalid volume: volume 748aa68d-8e09-40b9-8457-8e9e52b0c80e is already attached to instances: 100c216f-5533-4bf3-af33-bb5c6a45017d {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-003aac15-053e-4a06-9ffc-01516a5c760d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.179651 Oct 10 12:04:14.161490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 332/658] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:04:13 2022] POST /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments => generated 174 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:04:14.234309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:14.234806 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:14.240728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:14.241220 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:14.242628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:14.243630 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:14.244229 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:14.244758 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:14.343339 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lazy-loading 'services' on Instance uuid 100c216f-5533-4bf3-af33-bb5c6a45017d {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:14.448147 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8b256f08-cc47-41ef-b14b-46127c9b221e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments/748aa68d-8e09-40b9-8457-8e9e52b0c80e" status: 202 len: 0 microversion: 2.1 time: 0.217524 Oct 10 12:04:14.450214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 333/659] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:04:14 2022] DELETE /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments/748aa68d-8e09-40b9-8457-8e9e52b0c80e => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:14.468344 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:14.470915 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:14.481443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:14.481833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:04:14.482430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:04:14.483037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:14.483169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:04:14.483603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:04:14.484196 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:04:14.484546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:14.491029 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:14.491808 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:14.492570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:14.494191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:14.494714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:14.495215 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:14.496305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:14.496994 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:14.497678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:14.517282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for project 79aee39298624f99b33b9808fe5030f8. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:04:14.522051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Getting quotas for user 0c0f1d116c004694b33b19d988ac4959 and project 79aee39298624f99b33b9808fe5030f8. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:04:14.528705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-89c186a8-5b93-4520-badb-c4aeeccef012 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073424 Oct 10 12:04:14.530106 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 334/660] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:14 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:14.538155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:04:14.541479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:04:14.605669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5ec399f3-5811-4b62-84d8-110a86de0d01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749198 Oct 10 12:04:14.607015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 327/661] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:04:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:04:14.620410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-766c62d4-46a3-4d41-a323-b2e6f164ae73 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:14.621345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-766c62d4-46a3-4d41-a323-b2e6f164ae73 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:14.683960 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-766c62d4-46a3-4d41-a323-b2e6f164ae73 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:14.691637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-766c62d4-46a3-4d41-a323-b2e6f164ae73 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1237 microversion: 2.1 time: 0.077869 Oct 10 12:04:14.692840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 335/662] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:14 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:15.542593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:15.544901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:15.559719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.560593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.561277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:15.562508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.563464 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.564042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:15.637172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-52d6cad9-0a59-43db-9e18-3c09914b6f8e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099599 Oct 10 12:04:15.638078 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 328/663] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:15 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:04:15.716423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:15.718826 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:15.719673 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:15.720494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:15.732289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.733234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.733906 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:15.734711 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.735480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.737956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.738449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.738635 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:15.738875 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:15.739911 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.740369 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.740839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:15.771090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:04:15.851184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:15.865258 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-46a55edb-eb8f-4a81-b266-6bca88aca689 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1289 microversion: 2.1 time: 0.152961 Oct 10 12:04:15.878916 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 336/664] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:15 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:15.879123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f89f80f4-47f2-4a43-b7b7-867e6e0eb4b8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 204 len: 0 microversion: 2.1 time: 0.152214 Oct 10 12:04:15.879123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 329/665] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:04:15 2022] DELETE /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:04:15.879858 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:15.886728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:15.893603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.894241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.894780 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:15.896277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:15.897073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:15.897671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:16.118753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:16.127000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fa7917f8-5764-4e37-ac49-e882f47ab414 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1682 microversion: 2.1 time: 0.253806 Oct 10 12:04:16.143222 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 337/666] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:15 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:16.892415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:16.893236 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:16.900475 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:16.900964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:16.901400 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:16.902095 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:16.902548 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:16.903026 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:16.966391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:16.974067 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8787db4e-8086-429e-887c-5c88a89231a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1297 microversion: 2.1 time: 0.085894 Oct 10 12:04:16.974641 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 330/667] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:16 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:17.151763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:17.152364 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:17.158777 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:17.159285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:17.159718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:17.160406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:17.160857 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:17.161277 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:17.294534 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:17.302832 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-660d3f84-cd46-4985-bec1-6c32568472c1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1682 microversion: 2.1 time: 0.155663 Oct 10 12:04:17.303442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 338/668] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:17 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:17.997174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:17.997860 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:18.004642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:18.005209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:18.005796 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:18.006818 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:18.007380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:18.008057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:18.162057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:18.176349 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3b7b20d9-9780-4f22-bbe8-6e1cda4cf198 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1295 microversion: 2.1 time: 0.182444 Oct 10 12:04:18.177398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 331/669] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:17 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1295 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:18.332728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:18.334539 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:18.340465 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:18.346391 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:18.347141 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:18.348101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:18.349943 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:18.350523 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:18.351340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:18.734763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:18.745189 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e84bf049-bf24-438b-a827-73a14a6c3891 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1682 microversion: 2.1 time: 0.419693 Oct 10 12:04:18.746545 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 339/670] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:18 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:19.210147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:19.212209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:19.220758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:19.221479 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:19.222071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:19.223793 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:19.224462 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:19.225180 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:19.655326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:19.666960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c8897130-6ac3-4a95-b60c-2d3fb285fd01 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1363 microversion: 2.1 time: 0.469232 Oct 10 12:04:19.668071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 332/671] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:19 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:19.769430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:19.770825 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:19.786654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:19.787719 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:19.788587 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:19.790031 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:19.790753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:19.791364 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:19.932687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:19.940347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5a3694e4-8d44-4624-9c12-7f4c536ed2d2 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1614 microversion: 2.1 time: 0.174909 Oct 10 12:04:19.940927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 340/672] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:19 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1614 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:20.253548 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-e80e6414-d4ad-423e-86a5-0341ed750dce req-93bb3fe9-d3be-42db-bef1-09a3a4672454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c216f-5533-4bf3-af33-bb5c6a45017d", "name": "network-vif-deleted", "tag": "693388ca-7889-4616-8a3e-a5cc8e832bc3"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:20.299254 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e80e6414-d4ad-423e-86a5-0341ed750dce req-93bb3fe9-d3be-42db-bef1-09a3a4672454 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:20.301574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e80e6414-d4ad-423e-86a5-0341ed750dce req-93bb3fe9-d3be-42db-bef1-09a3a4672454 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:20.302063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e80e6414-d4ad-423e-86a5-0341ed750dce req-93bb3fe9-d3be-42db-bef1-09a3a4672454 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:20.323617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-e80e6414-d4ad-423e-86a5-0341ed750dce req-93bb3fe9-d3be-42db-bef1-09a3a4672454 service nova] Creating event network-vif-deleted:693388ca-7889-4616-8a3e-a5cc8e832bc3 for instance 100c216f-5533-4bf3-af33-bb5c6a45017d on hv-cinder-85061 Oct 10 12:04:20.331324 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-e80e6414-d4ad-423e-86a5-0341ed750dce req-93bb3fe9-d3be-42db-bef1-09a3a4672454 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096546 Oct 10 12:04:20.336032 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 333/673] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:20.759330 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:20.760207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:20.768016 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:20.768923 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:20.769779 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:20.771434 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:20.772568 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:20.773070 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:20.967415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:20.968133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:20.977587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:20.978400 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:20.978844 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:20.980135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:20.980787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:20.981224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:21.021986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:21.036240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9160dd57-c74d-414d-b0b2-9c7ea6f367b9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1363 microversion: 2.1 time: 0.347859 Oct 10 12:04:21.042379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:21.043038 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:21.043535 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:21.044038 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lazy-loading 'fault' on Instance uuid 100c216f-5533-4bf3-af33-bb5c6a45017d {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:21.053908 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 341/674] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:20 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:21.107708 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:21.126571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0b73b4c0-da51-4857-9b78-6465395b7c90 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 200 len: 1331 microversion: 2.1 time: 0.164543 Oct 10 12:04:21.129420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 334/675] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:20 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:22.064865 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:22.065481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:22.072101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:22.072588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:22.073026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:22.073713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:22.074163 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:22.074582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:22.155360 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:22.155902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:22.163099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:22.163669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:22.164217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:22.165006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:22.166149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:22.166659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:22.192103 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d HTTP/1.1 Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:04:22.194328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:04:22.195763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '100c216f-5533-4bf3-af33-bb5c6a45017d'} Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:22.198045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:04:22.200028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:22.203136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:22.203136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-161b7528-1683-4e63-bcbe-71b7861411d5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 404 len: 111 microversion: 2.1 time: 0.045992 Oct 10 12:04:22.203136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 335/676] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:22 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:04:22.205885 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d9d96a4-01d4-4f9e-b0db-36b2a997c411 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '.version_select at 0x7f8620413700>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:22.226755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d9d96a4-01d4-4f9e-b0db-36b2a997c411 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186027416" status: 202 len: 0 microversion: 2.1 time: 0.024927 Oct 10 12:04:22.227624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 336/677] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Oct 10 12:04:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186027416 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:22.233747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:22.245697 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b64003b0-173b-44e9-9166-59ade6a6311e tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1363 microversion: 2.1 time: 0.184512 Oct 10 12:04:22.247199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 342/678] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:22 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:22.551922 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-1e4fc3f3-33b7-4626-83ce-8893d476ebb4 req-4284eca3-17c8-40de-8fac-1c33b04c883b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6684b0b5-2c8b-4650-9955-769f646d7173", "tag": "099a0b78-937e-408f-b139-3ca52765679d"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:22.562646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1e4fc3f3-33b7-4626-83ce-8893d476ebb4 req-4284eca3-17c8-40de-8fac-1c33b04c883b service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:22.563151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1e4fc3f3-33b7-4626-83ce-8893d476ebb4 req-4284eca3-17c8-40de-8fac-1c33b04c883b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:22.563962 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-1e4fc3f3-33b7-4626-83ce-8893d476ebb4 req-4284eca3-17c8-40de-8fac-1c33b04c883b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:22.574858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-1e4fc3f3-33b7-4626-83ce-8893d476ebb4 req-4284eca3-17c8-40de-8fac-1c33b04c883b service nova] Creating event network-changed:099a0b78-937e-408f-b139-3ca52765679d for instance 6684b0b5-2c8b-4650-9955-769f646d7173 on hv-cinder-85061 Oct 10 12:04:22.580209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-1e4fc3f3-33b7-4626-83ce-8893d476ebb4 req-4284eca3-17c8-40de-8fac-1c33b04c883b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032485 Oct 10 12:04:22.580794 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 337/679] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:22.839925 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1601923b-a83a-4889-886e-cc9a00412ef9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: .version_select at 0x7f8620512280>, body: {"keypair": {"name": "tempest-keypair-200621902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTniOr2/7/d1jPZZErUNwSthf9DPz9J2SJZR5TGzys5z/8ugGIPZzUZ5DEQ7a0XQb8VdIx4Hck6FILEyHASVhSr/dbuKUlMCPg4MeWQ9okj/JM1RY/9XB8JiAFva5scyA=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:22.855585 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-1601923b-a83a-4889-886e-cc9a00412ef9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:04:22.859365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-1601923b-a83a-4889-886e-cc9a00412ef9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:04:22.880956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1601923b-a83a-4889-886e-cc9a00412ef9 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045534 Oct 10 12:04:22.881522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 343/680] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:04:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:23.270183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:23.271019 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:23.284762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:23.285326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:23.285831 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:23.286680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:23.287245 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:23.287733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:23.510973 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:23.519163 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-583a25a7-9526-4216-9a25-8acd599205a6 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1363 microversion: 2.1 time: 0.253208 Oct 10 12:04:23.519733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 338/681] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:23 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:24.152281 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-998226636", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05a9786c-a8d0-4fea-bd0d-744e4b7d958a"}], "security_groups": [{"name": "tempest-securitygroup--74579552"}], "key_name": "tempest-keypair-200621902", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:24.263191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] validate_networks() for [('05a9786c-a8d0-4fea-bd0d-744e4b7d958a', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:04:24.543420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:24.544271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:24.547183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:24.548113 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:24.555157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:24.555750 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:24.556308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:24.557253 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:24.557782 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:24.558278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:24.768705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:24.776841 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a2a27703-14f7-4064-92c2-4097a135619d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1363 microversion: 2.1 time: 0.238618 Oct 10 12:04:24.777502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 339/682] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:24 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:24.807377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:04:24.807798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:04:24.808270 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:04:24.808683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:04:24.809089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:04:24.817784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:24.818263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:24.818699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:24.819458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:24.819918 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:24.820365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:24.836466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:04:24.840911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Getting quotas for user 2f7735444ca8431ea7906070374dbe67 and project de3e893bfb574016a6e5e020f96490c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:04:24.851619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:04:24.854565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:04:24.902626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d459e48e-cca3-4999-ac7d-22390089f69f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.755149 Oct 10 12:04:24.903313 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 344/683] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:04:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:04:24.914472 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9e63b43c-2073-45c6-81d5-5954597f1c29 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:24.915122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9e63b43c-2073-45c6-81d5-5954597f1c29 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:24.970099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9e63b43c-2073-45c6-81d5-5954597f1c29 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:24.976901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9e63b43c-2073-45c6-81d5-5954597f1c29 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1240 microversion: 2.1 time: 0.066380 Oct 10 12:04:24.977665 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 340/684] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:24 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:25.800944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:25.801571 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:25.808354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:25.808833 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:25.809350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:25.810071 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:25.810524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:25.810972 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:25.949475 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:25.957306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cc0240b3-2445-4a2d-88e8-5e78d4474794 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1363 microversion: 2.1 time: 0.161106 Oct 10 12:04:25.957883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 345/685] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:25 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:25.999183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:25.999891 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:26.006680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:26.007231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:26.007668 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:26.008372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:26.009539 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:26.009802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:26.073867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:26.078585 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-7c17f5dd-9f16-4123-813c-4c3204caa9f0 req-62088ba0-7def-4117-92da-e6f3536eff14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6684b0b5-2c8b-4650-9955-769f646d7173", "name": "network-vif-plugged", "status": "completed", "tag": "099a0b78-937e-408f-b139-3ca52765679d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:26.083074 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cc03e139-f3e6-4f71-bc94-e7a71a40a83b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1292 microversion: 2.1 time: 0.087721 Oct 10 12:04:26.089368 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c17f5dd-9f16-4123-813c-4c3204caa9f0 req-62088ba0-7def-4117-92da-e6f3536eff14 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:26.089852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c17f5dd-9f16-4123-813c-4c3204caa9f0 req-62088ba0-7def-4117-92da-e6f3536eff14 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:26.090280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c17f5dd-9f16-4123-813c-4c3204caa9f0 req-62088ba0-7def-4117-92da-e6f3536eff14 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:26.093129 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:26.095666 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 341/686] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:25 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:26.103981 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-7c17f5dd-9f16-4123-813c-4c3204caa9f0 req-62088ba0-7def-4117-92da-e6f3536eff14 service nova] Creating event network-vif-plugged:099a0b78-937e-408f-b139-3ca52765679d for instance 6684b0b5-2c8b-4650-9955-769f646d7173 on hv-cinder-85061 Oct 10 12:04:26.108981 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-7c17f5dd-9f16-4123-813c-4c3204caa9f0 req-62088ba0-7def-4117-92da-e6f3536eff14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034934 Oct 10 12:04:26.109597 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 346/687] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:04:26.982204 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:26.982819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:26.988653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:26.989135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:26.989570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:26.990262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:26.990723 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:26.991178 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:27.109376 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:27.110189 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:27.116603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:27.117170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:27.117700 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:27.118465 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:27.119018 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:27.119513 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:27.176983 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:27.184686 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e4d42d91-12ee-4d70-9847-6b8fc5eb8cbd tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1363 microversion: 2.1 time: 0.206805 Oct 10 12:04:27.185198 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 342/688] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:26 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:27.194946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:27.204907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-72d9cdfb-0590-4392-940e-d1f3dbcd9c3f tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1298 microversion: 2.1 time: 0.100445 Oct 10 12:04:27.205989 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 347/689] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:27 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:28.176199 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c3e97792-0910-4b59-9d2d-5ab8837bd78b req-d8e8cc5f-f92a-41cb-afcb-c9a4cfae4e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306c1542-d247-4dee-84ff-b93cf2e010c7", "tag": "ec05fa9f-369d-453e-9947-0e2f98a5821f"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:28.186467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c3e97792-0910-4b59-9d2d-5ab8837bd78b req-d8e8cc5f-f92a-41cb-afcb-c9a4cfae4e27 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:28.187153 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c3e97792-0910-4b59-9d2d-5ab8837bd78b req-d8e8cc5f-f92a-41cb-afcb-c9a4cfae4e27 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:28.187386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c3e97792-0910-4b59-9d2d-5ab8837bd78b req-d8e8cc5f-f92a-41cb-afcb-c9a4cfae4e27 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:28.198094 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c3e97792-0910-4b59-9d2d-5ab8837bd78b req-d8e8cc5f-f92a-41cb-afcb-c9a4cfae4e27 service nova] Creating event network-changed:ec05fa9f-369d-453e-9947-0e2f98a5821f for instance 306c1542-d247-4dee-84ff-b93cf2e010c7 on hv-cinder-85061 Oct 10 12:04:28.203737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c3e97792-0910-4b59-9d2d-5ab8837bd78b req-d8e8cc5f-f92a-41cb-afcb-c9a4cfae4e27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031342 Oct 10 12:04:28.204667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 343/690] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:28.208209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:28.208984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:28.215193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:28.215658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:28.216092 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:28.216783 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:28.217238 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:28.217684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:28.230196 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:28.230914 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:28.237388 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:28.237872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:28.238308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:28.239044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:28.239504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:28.239928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:28.245655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:28.420081 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:28.427285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:28.428093 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f65c2306-fca9-427d-8653-7eea94a4d9c4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1549 microversion: 2.1 time: 0.223680 Oct 10 12:04:28.428659 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 348/691] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:28 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:28.435174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2850fb55-f296-4dd4-84c2-42f55a32938c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.210002 Oct 10 12:04:28.435730 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 344/692] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:28 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:28.450788 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:28.451326 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:28.457162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:28.457658 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:28.458103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:28.458805 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:28.459296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:28.459743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:28.568682 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-df885f47-291e-4357-9197-ba11e5c56a33 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122133 Oct 10 12:04:28.569315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 349/693] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 12:04:28 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:29.458591 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:29.459224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:29.465608 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:29.466087 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:29.466526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:29.467246 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:29.467698 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:29.468115 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:29.808452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:29.816208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3a3d8ffb-c1e4-448c-88af-d19e10129512 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.361418 Oct 10 12:04:29.817757 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 345/694] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:29 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:30.266845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-8884391c-8297-4269-8b92-7b471820c550 req-848c4926-ec16-4c1e-9994-047774a2bdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6684b0b5-2c8b-4650-9955-769f646d7173", "tag": "099a0b78-937e-408f-b139-3ca52765679d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:30.276014 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8884391c-8297-4269-8b92-7b471820c550 req-848c4926-ec16-4c1e-9994-047774a2bdaa service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:30.276499 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8884391c-8297-4269-8b92-7b471820c550 req-848c4926-ec16-4c1e-9994-047774a2bdaa service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:30.276928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8884391c-8297-4269-8b92-7b471820c550 req-848c4926-ec16-4c1e-9994-047774a2bdaa service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:30.287807 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-8884391c-8297-4269-8b92-7b471820c550 req-848c4926-ec16-4c1e-9994-047774a2bdaa service nova] Creating event network-changed:099a0b78-937e-408f-b139-3ca52765679d for instance 6684b0b5-2c8b-4650-9955-769f646d7173 on hv-cinder-85061 Oct 10 12:04:30.292766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-8884391c-8297-4269-8b92-7b471820c550 req-848c4926-ec16-4c1e-9994-047774a2bdaa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030018 Oct 10 12:04:30.293543 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 350/695] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:30.838842 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:30.839463 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:30.845825 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:30.846313 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:30.846747 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:30.847468 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:30.847921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:30.848340 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:30.987444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:30.995557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24bab360-1d59-4b4b-998b-9540e4b2e965 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.160735 Oct 10 12:04:30.996338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 346/696] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:30 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:32.021535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:32.022971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:32.031130 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:32.031755 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:32.032206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:32.032915 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:32.033432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:32.033869 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:32.115469 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:32.116535 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:32.123570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:32.124063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:32.124504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:32.125206 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:32.125664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:32.126090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:32.171260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:32.179888 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5592a1e4-fd33-4e84-87a5-d162fa7983c5 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.164636 Oct 10 12:04:32.180467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 351/697] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:32 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:32.221518 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'services' on Instance uuid 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:32.296966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dcc31869-8697-476d-8b36-3cf3b98bbb47 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments/8d904a23-8af0-438b-93a8-2b70ec7cfe6c" status: 202 len: 0 microversion: 2.1 time: 0.185102 Oct 10 12:04:32.297580 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 347/698] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:04:32 2022] DELETE /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments/8d904a23-8af0-438b-93a8-2b70ec7cfe6c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:32.307532 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:32.309696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:32.315599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:32.316125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:32.316573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:32.317312 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:32.317740 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:32.318164 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:32.348236 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-36d6b5dd-947b-4abd-b28e-ef816209512f tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Oct 10 12:04:32.348808 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 352/699] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:32 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:33.203238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:33.203935 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:33.210456 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.210991 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.211427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.212625 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.213080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.213504 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.360762 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:33.363079 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:33.369702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.370201 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.370641 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.371419 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.371881 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.372479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.414909 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f34b6956-3771-4c7e-a249-e3a7f7636b19 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058644 Oct 10 12:04:33.416163 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 353/700] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:04:33 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 12:04:33.499802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:33.500304 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:33.506160 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.506646 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.507140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.507830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.508308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.509263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.525846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:33.533595 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc1df777-daa4-4fec-b7eb-543141b813f4 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.335705 Oct 10 12:04:33.534256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 348/701] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:33 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:33.536459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:04:33.611343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7a6824e7-9cc9-4e73-8bbe-6be51bcd5557 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 204 len: 0 microversion: 2.1 time: 0.114939 Oct 10 12:04:33.612060 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 354/702] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:04:33 2022] DELETE /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:04:33.620217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:33.620828 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:33.626699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.627923 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.627923 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.628390 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:33.628793 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:33.629227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:33.765137 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:33.772970 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5f29def3-efe9-4321-bc11-f8d4c348b48a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1690 microversion: 2.1 time: 0.156567 Oct 10 12:04:33.773569 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 349/703] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:33 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:34.106181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-45d40c37-2e97-4757-bf4a-fb6fbff2e9af req-8df86105-d25f-4849-ae65-b4fcb0403ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306c1542-d247-4dee-84ff-b93cf2e010c7", "name": "network-vif-plugged", "status": "completed", "tag": "ec05fa9f-369d-453e-9947-0e2f98a5821f"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:34.115752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-45d40c37-2e97-4757-bf4a-fb6fbff2e9af req-8df86105-d25f-4849-ae65-b4fcb0403ec1 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:34.116292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-45d40c37-2e97-4757-bf4a-fb6fbff2e9af req-8df86105-d25f-4849-ae65-b4fcb0403ec1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:34.116844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-45d40c37-2e97-4757-bf4a-fb6fbff2e9af req-8df86105-d25f-4849-ae65-b4fcb0403ec1 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:34.127960 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-45d40c37-2e97-4757-bf4a-fb6fbff2e9af req-8df86105-d25f-4849-ae65-b4fcb0403ec1 service nova] Creating event network-vif-plugged:ec05fa9f-369d-453e-9947-0e2f98a5821f for instance 306c1542-d247-4dee-84ff-b93cf2e010c7 on hv-cinder-85061 Oct 10 12:04:34.132669 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-45d40c37-2e97-4757-bf4a-fb6fbff2e9af req-8df86105-d25f-4849-ae65-b4fcb0403ec1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031045 Oct 10 12:04:34.133267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 355/704] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:04:34.556308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:34.556973 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:34.563385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:34.563870 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:34.564297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:34.564977 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:34.565427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:34.565847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:34.690071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:34.698384 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ad13015f-59a1-4a05-94ad-09d55473568d tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.146351 Oct 10 12:04:34.698978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 350/705] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:34 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:34.798176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:34.798933 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:34.805287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:34.805770 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:34.806212 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:34.806910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:34.807371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:34.807795 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:34.827934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:34.847046 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=16 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:34.935591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:34.943394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e0031bd5-aecd-4d17-9c20-a2e47851d765 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1690 microversion: 2.1 time: 0.149845 Oct 10 12:04:34.943898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 356/706] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:34 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:35.721216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:35.721742 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:35.723718 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:35.729817 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:35.730301 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:35.730738 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:35.731456 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:35.731913 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:35.732338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:35.860609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:35.868179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ec11c9d2-9b31-453a-967a-424261efc23e tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.151012 Oct 10 12:04:35.868735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 351/707] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:35 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:35.966718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:35.967366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:35.973790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:35.974272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:35.974741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:35.975453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:35.975907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:35.976327 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:36.101023 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:36.109228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-40e68f10-f9ae-464d-81ab-d2bf69c45739 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1690 microversion: 2.1 time: 0.146338 Oct 10 12:04:36.110050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 357/708] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:35 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:36.892386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:36.893210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:36.901440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:36.901915 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:36.902342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:36.903062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:36.904279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:36.904694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:37.035819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:37.045286 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8fe452a4-422a-4142-bfb3-ee31d4ba00a3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.156734 Oct 10 12:04:37.045892 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 352/709] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:36 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:37.131998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:37.132620 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:37.139523 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:37.140012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:37.140453 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:37.141151 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:37.141608 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:37.142045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:37.393458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:37.401736 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ed56990e-75c5-4736-935a-f818b025caf2 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1690 microversion: 2.1 time: 0.272990 Oct 10 12:04:37.402513 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 358/710] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:37 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1690 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:38.074326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:38.076244 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-3de3b281-a801-40c5-8b67-df9508562262 req-c0d5b3cb-463f-404d-b9da-f4a6347e0773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3", "name": "network-vif-deleted", "tag": "45df0c70-afe6-4d06-b061-e7e825e93be9"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:38.078548 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:38.087055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:38.087546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3de3b281-a801-40c5-8b67-df9508562262 req-c0d5b3cb-463f-404d-b9da-f4a6347e0773 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:38.089745 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:38.090546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:38.091182 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:38.091411 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3de3b281-a801-40c5-8b67-df9508562262 req-c0d5b3cb-463f-404d-b9da-f4a6347e0773 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:38.092317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3de3b281-a801-40c5-8b67-df9508562262 req-c0d5b3cb-463f-404d-b9da-f4a6347e0773 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:38.092441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:38.093019 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:38.093732 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:38.106086 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-3de3b281-a801-40c5-8b67-df9508562262 req-c0d5b3cb-463f-404d-b9da-f4a6347e0773 service nova] Creating event network-vif-deleted:45df0c70-afe6-4d06-b061-e7e825e93be9 for instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 on hv-cinder-85061 Oct 10 12:04:38.112681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-3de3b281-a801-40c5-8b67-df9508562262 req-c0d5b3cb-463f-404d-b9da-f4a6347e0773 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039853 Oct 10 12:04:38.113786 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 359/711] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:38.258673 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:38.272883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7611f6df-7640-4ff3-83e6-0fe124bdc3a1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1364 microversion: 2.1 time: 0.207926 Oct 10 12:04:38.273574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 353/712] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:38 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:38.426317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:38.427053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:38.433603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:38.434089 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:38.434528 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:38.435269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:38.435731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:38.436159 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:38.472265 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:38.472760 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:38.473197 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:38.473965 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'fault' on Instance uuid 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:38.524738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:38.532643 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf2e9f48-a943-4a37-bc76-dcac4a3217b4 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1335 microversion: 2.1 time: 0.111021 Oct 10 12:04:38.533210 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 360/713] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:38 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:39.296354 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:39.296970 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:39.303542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:39.304019 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:39.304448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:39.305129 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:39.305578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:39.306031 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:39.433176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:39.440944 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0e4fc505-53c2-46ba-8cce-cc36f38fa7f3 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1554 microversion: 2.1 time: 0.148429 Oct 10 12:04:39.441509 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 354/714] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:39 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:39.464466 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:39.465099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:39.472548 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:39.473436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:39.474039 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:39.475214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:39.475680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:39.476113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:39.557848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:39.558091 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e6759e64-d07b-477d-9228-db419d2f612a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097612 Oct 10 12:04:39.558495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:39.558824 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 361/715] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Oct 10 12:04:39 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:39.565379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:39.566032 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:39.566607 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:39.567442 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:39.567977 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:39.568474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:39.604323 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:39.605083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:39.605614 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:39.606055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'fault' on Instance uuid 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:39.681486 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:39.689172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8afa820e-f161-4909-ab68-c76efeb6058d tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 200 len: 1335 microversion: 2.1 time: 0.136316 Oct 10 12:04:39.689762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 355/716] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:39 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 1335 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:40.712985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:40.713609 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:40.719515 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:40.720006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:40.720438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:40.721302 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:40.721767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:40.722261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:40.736179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] HTTP exception thrown: Instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 could not be found. Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Request method failure captured: Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 HTTP/1.1 Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkc6ANJAn4uWtl_9BYI0POST6SAJGl-9w8hepgSBg41ul6fod8KOQddqQkxt1Uw-ZG8vRij_xsT-LzUklmeqbM4dSCd-LTGn5cNdEAEWq0Ox0m4Yc5Ojo99W3zjXXSDMI_atXaQKn5Q67dJ5BUtLcftGHaFeozYhYayoWEXU009_tI Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:04:40.737984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b72dcfa7755e499f8f55ade0fde3d7c7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}] Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 99b3e727e6fa480c90a054a60b68b8d0 Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 could not be found. Oct 10 12:04:40.739592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3'} Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 could not be found. Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:40.740512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 could not be found. Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 could not be found. Oct 10 12:04:40.742011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:40.748050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Returning 404 to user: Instance 59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:40.748050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b5915918-39eb-4ca1-bcff-01de3307fec5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3" status: 404 len: 111 microversion: 2.1 time: 0.032623 Oct 10 12:04:40.748050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 362/717] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:40 2022] GET /compute/v2.1/servers/59a3a3f3-6ef0-4c5e-bd05-1cf7414ac4a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:04:40.752045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a91a1194-231c-4ddb-adf2-10e6b45c3e49 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '.version_select at 0x7f8620a4b310>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:40.773964 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a456ebe9-68ae-48a9-bdd1-5171123e1a8d req-6672b1d1-a1d3-4f71-9c8b-eb201cc091b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306c1542-d247-4dee-84ff-b93cf2e010c7", "tag": "ec05fa9f-369d-453e-9947-0e2f98a5821f"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:40.774179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a91a1194-231c-4ddb-adf2-10e6b45c3e49 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086426870" status: 202 len: 0 microversion: 2.1 time: 0.026312 Oct 10 12:04:40.774601 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 356/718] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Oct 10 12:04:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086426870 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:04:40.784823 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a456ebe9-68ae-48a9-bdd1-5171123e1a8d req-6672b1d1-a1d3-4f71-9c8b-eb201cc091b3 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:40.785399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a456ebe9-68ae-48a9-bdd1-5171123e1a8d req-6672b1d1-a1d3-4f71-9c8b-eb201cc091b3 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:40.786076 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a456ebe9-68ae-48a9-bdd1-5171123e1a8d req-6672b1d1-a1d3-4f71-9c8b-eb201cc091b3 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:40.798717 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a456ebe9-68ae-48a9-bdd1-5171123e1a8d req-6672b1d1-a1d3-4f71-9c8b-eb201cc091b3 service nova] Creating event network-changed:ec05fa9f-369d-453e-9947-0e2f98a5821f for instance 306c1542-d247-4dee-84ff-b93cf2e010c7 on hv-cinder-85061 Oct 10 12:04:40.804026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a456ebe9-68ae-48a9-bdd1-5171123e1a8d req-6672b1d1-a1d3-4f71-9c8b-eb201cc091b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033642 Oct 10 12:04:40.804706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 363/719] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:04:43.751988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:43.752484 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:43.758413 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:43.758910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:43.759356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:43.760043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:43.760500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:43.760921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:43.785962 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:04:43.861002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5b136028-8170-43ea-94be-f07aeb1e5778 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "DELETE /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 204 len: 0 microversion: 2.1 time: 0.112974 Oct 10 12:04:43.861617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 357/720] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:04:43 2022] DELETE /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:04:43.872642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:43.873367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:43.879775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:43.880288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:43.880738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:43.881432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:43.881917 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:43.882378 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:44.010545 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:44.018154 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d1a21654-8885-4651-a7cd-558f4a77818a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1507 microversion: 2.1 time: 0.150584 Oct 10 12:04:44.018723 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 364/721] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:43 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:45.042008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:45.042739 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:45.049149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:45.049878 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:45.050314 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:45.051027 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:45.051478 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:45.051901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:45.177683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:45.185447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-95b203ff-0186-492c-902d-f5e2154637d1 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1507 microversion: 2.1 time: 0.148455 Oct 10 12:04:45.186014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 358/722] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:45 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:46.208619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:46.209236 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:46.215977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:46.216462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:46.216897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:46.217640 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:46.218096 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:46.218577 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:46.233851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:46.354198 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:46.361861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-50cddb91-0b58-4cfb-b4c9-935ba56f8298 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1507 microversion: 2.1 time: 0.157177 Oct 10 12:04:46.362426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 365/723] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:46 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:46.883251 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-642421bc-2451-4524-9a73-5ab160191ff7 req-3f2ee3c0-1aac-46df-b973-ea7dc2a220b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ca0d44-4c8c-44a3-b638-4983f27a9aba", "name": "network-vif-deleted", "tag": "32e17a37-9b9d-4960-877e-e2b3e5fc255f"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:46.894577 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-642421bc-2451-4524-9a73-5ab160191ff7 req-3f2ee3c0-1aac-46df-b973-ea7dc2a220b8 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:46.895398 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-642421bc-2451-4524-9a73-5ab160191ff7 req-3f2ee3c0-1aac-46df-b973-ea7dc2a220b8 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:46.895915 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-642421bc-2451-4524-9a73-5ab160191ff7 req-3f2ee3c0-1aac-46df-b973-ea7dc2a220b8 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:46.900498 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:46.909107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-642421bc-2451-4524-9a73-5ab160191ff7 req-3f2ee3c0-1aac-46df-b973-ea7dc2a220b8 service nova] Creating event network-vif-deleted:32e17a37-9b9d-4960-877e-e2b3e5fc255f for instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba on hv-cinder-85061 Oct 10 12:04:46.914480 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-642421bc-2451-4524-9a73-5ab160191ff7 req-3f2ee3c0-1aac-46df-b973-ea7dc2a220b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038256 Oct 10 12:04:46.915549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 359/724] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:47.386160 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:47.386775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:47.393234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:47.393712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:47.394146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:47.394833 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:47.395320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:47.395746 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:47.426022 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:47.426444 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:47.426878 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:47.427343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'fault' on Instance uuid 42ca0d44-4c8c-44a3-b638-4983f27a9aba {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:47.470937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:47.478454 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3651a8bc-78f3-4b83-bfa6-ccd09a5b1da5 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 200 len: 1311 microversion: 2.1 time: 0.096713 Oct 10 12:04:47.479042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 366/725] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:47 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:48.482774 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:48.483380 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:48.490601 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.491108 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.491548 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.492234 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.492685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.493107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.501243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:48.501862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 42ca0d44-4c8c-44a3-b638-4983f27a9aba] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:48.504332 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:48.509592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.510592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.511061 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.511765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.512265 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.512697 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.518961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:04:48.528339 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] HTTP exception thrown: Instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba could not be found. Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Request method failure captured: Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba HTTP/1.1 Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkc6ANJAn4uWtl_9BYI0POST6SAJGl-9w8hepgSBg41ul6fod8KOQddqQkxt1Uw-ZG8vRij_xsT-LzUklmeqbM4dSCd-LTGn5cNdEAEWq0Ox0m4Yc5Ojo99W3zjXXSDMI_atXaQKn5Q67dJ5BUtLcftGHaFeozYhYayoWEXU009_tI Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:04:48.529983 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b72dcfa7755e499f8f55ade0fde3d7c7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}] Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 99b3e727e6fa480c90a054a60b68b8d0 Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba could not be found. Oct 10 12:04:48.531604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '42ca0d44-4c8c-44a3-b638-4983f27a9aba'} Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba could not be found. Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:48.532340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba could not be found. Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba could not be found. Oct 10 12:04:48.533631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:48.535145 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Returning 404 to user: Instance 42ca0d44-4c8c-44a3-b638-4983f27a9aba could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:48.535145 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f99f2cff-23da-477d-ba5a-ccda819bbb99 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba" status: 404 len: 111 microversion: 2.1 time: 0.034029 Oct 10 12:04:48.535145 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 367/726] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:48 2022] GET /compute/v2.1/servers/42ca0d44-4c8c-44a3-b638-4983f27a9aba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:04:48.539614 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:48.540116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:48.546119 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.546610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.547098 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.547803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.548264 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.548695 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.574776 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:04:48.600369 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-68d008b7-f42d-4f07-b54a-993d6ed0e2dc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 204 len: 0 microversion: 2.1 time: 0.122454 Oct 10 12:04:48.601316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 360/727] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:04:48 2022] DELETE /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:04:48.611858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:48.612556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:48.619221 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.619765 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.620215 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.620958 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.621454 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.621956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.661167 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-836527c8-add7-4e4e-8dfd-50d8f8086566 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 204 len: 0 microversion: 2.1 time: 0.124747 Oct 10 12:04:48.661702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 368/728] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:04:48 2022] DELETE /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:04:48.670332 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:48.671250 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:48.677386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.677874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.678316 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.679038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:48.679511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:48.679940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:48.792123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:48.800271 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e6f9de16-062f-4898-a8d9-4ea53d9017d3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1578 microversion: 2.1 time: 0.192345 Oct 10 12:04:48.800845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 361/729] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:48 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:48.835564 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:48.843000 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f8ee9cc6-56ce-4845-87f0-396de703340a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.176824 Oct 10 12:04:48.843809 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 369/730] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:48 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:49.824511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:49.825134 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:49.831596 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:49.832083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:49.832521 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:49.833211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:49.833669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:49.834096 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:49.865937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:49.866699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:49.874628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:49.875399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:49.875836 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:49.876539 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:49.876993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:49.877410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:50.029341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:50.037148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-75e06de6-e0da-4d05-bf64-26bfb2ac2a81 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1578 microversion: 2.1 time: 0.217166 Oct 10 12:04:50.037735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 362/731] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:49 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:50.055184 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:50.062664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9f0aedf1-2914-4f68-a6b0-95a9df6cea09 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.201058 Oct 10 12:04:50.063310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 370/732] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:49 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:51.059986 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:51.060631 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:51.067110 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:51.067597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:51.068064 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:51.068759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:51.069220 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:51.069649 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:51.086495 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:51.087136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:51.093996 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:51.094477 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:51.094918 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:51.095605 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:51.096085 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:51.096502 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:51.266902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:51.269699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:51.274693 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dded6ff9-a85a-457c-ae57-cf9b7f09bcd7 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1578 microversion: 2.1 time: 0.218579 Oct 10 12:04:51.276047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 363/733] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:51 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:51.277990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4212ab87-5d49-4156-be7a-6136300468ee tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.195430 Oct 10 12:04:51.278557 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 371/734] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:51 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:52.298312 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:52.298865 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:52.301370 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:52.301991 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:52.305618 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:52.306108 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:52.307256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:52.307954 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:52.308419 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:52.308850 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:52.308950 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:52.309427 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:52.309870 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:52.310566 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:52.311055 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:52.311485 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:52.496134 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:52.503721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7d3915d9-0194-4744-8739-79754d273a6a tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.206327 Oct 10 12:04:52.504289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 372/735] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:52 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:52.504414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:52.512620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fd59ac5e-9147-4091-98ee-59e83d048f4a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1578 microversion: 2.1 time: 0.218375 Oct 10 12:04:52.513179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 364/736] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:52 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:53.528179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:53.530191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:53.534966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:53.535413 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:53.535512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:53.535606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:53.535864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:53.536557 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:53.537009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:53.537569 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:53.543240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:53.543469 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:53.544042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:53.544826 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:53.545356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:53.545856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:53.936802 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:53.944573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd56b3ec-e51e-43ba-81cc-f376bee6e698 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1521 microversion: 2.1 time: 0.420742 Oct 10 12:04:53.945340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 373/737] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:53 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:53.946148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:53.955084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-47bf35a2-d7bf-4f39-bf25-e900d493b9d6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1578 microversion: 2.1 time: 0.423809 Oct 10 12:04:53.955693 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 365/738] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:53 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1578 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:54.517251 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-42846953-8f20-41cd-a713-78edcbafcee6 req-3859766e-e065-41a7-a10e-7ab97dd5d047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0079dd21-134c-4eba-b98a-5e223f5bfb49", "name": "network-vif-deleted", "tag": "b6770e59-ceb9-442a-901d-70ac68923881"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:54.531985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-42846953-8f20-41cd-a713-78edcbafcee6 req-3859766e-e065-41a7-a10e-7ab97dd5d047 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:54.532647 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-42846953-8f20-41cd-a713-78edcbafcee6 req-3859766e-e065-41a7-a10e-7ab97dd5d047 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:54.532997 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-42846953-8f20-41cd-a713-78edcbafcee6 req-3859766e-e065-41a7-a10e-7ab97dd5d047 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:54.552331 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-42846953-8f20-41cd-a713-78edcbafcee6 req-3859766e-e065-41a7-a10e-7ab97dd5d047 service nova] Creating event network-vif-deleted:b6770e59-ceb9-442a-901d-70ac68923881 for instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 on hv-cinder-85061 Oct 10 12:04:54.558937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-42846953-8f20-41cd-a713-78edcbafcee6 req-3859766e-e065-41a7-a10e-7ab97dd5d047 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184514 Oct 10 12:04:54.559860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 374/739] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:54.969632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:54.970307 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:54.979527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:54.980249 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:54.992740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:54.993235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:54.993668 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:54.994945 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:54.995753 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:54.996455 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:54.997933 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:54.998511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:54.998978 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:54.999920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:55.001167 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:55.001772 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:55.036517 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:55.037407 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:55.038058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:55.038740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lazy-loading 'fault' on Instance uuid 0079dd21-134c-4eba-b98a-5e223f5bfb49 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:04:55.122546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3e727e6fa480c90a054a60b68b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dcfa7755e499f8f55ade0fde3d7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:55.130586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-01336df6-3838-49e3-9b79-08b4484c0e37 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 200 len: 1311 microversion: 2.1 time: 0.164971 Oct 10 12:04:55.131444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 366/740] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:54 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:55.145661 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:55.155459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1a56b31b-c1e2-4e65-8280-c0db851ab5b2 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 200 len: 1510 microversion: 2.1 time: 0.179124 Oct 10 12:04:55.156701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 375/741] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:54 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:04:56.154252 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:56.154771 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] [instance: 0079dd21-134c-4eba-b98a-5e223f5bfb49] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:56.161266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:56.161754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:56.162189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:56.162876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:56.163350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:56.163775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:56.177963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] HTTP exception thrown: Instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 could not be found. Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Request method failure captured: Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 HTTP/1.1 Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkc6ANJAn4uWtl_9BYI0POST6SAJGl-9w8hepgSBg41ul6fod8KOQddqQkxt1Uw-ZG8vRij_xsT-LzUklmeqbM4dSCd-LTGn5cNdEAEWq0Ox0m4Yc5Ojo99W3zjXXSDMI_atXaQKn5Q67dJ5BUtLcftGHaFeozYhYayoWEXU009_tI Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:04:56.179650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b72dcfa7755e499f8f55ade0fde3d7c7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b72dcfa7755e499f8f55ade0fde3d7c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b72dcfa7755e499f8f55ade0fde3d7c7"}]}] Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: b72dcfa7755e499f8f55ade0fde3d7c7 Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1907734826 Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 99b3e727e6fa480c90a054a60b68b8d0 Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1907734826-project Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 could not be found. Oct 10 12:04:56.181966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '0079dd21-134c-4eba-b98a-5e223f5bfb49'} Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 could not be found. Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:56.182928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 could not be found. Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 could not be found. Oct 10 12:04:56.184555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.185917 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:56.186770 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] Returning 404 to user: Instance 0079dd21-134c-4eba-b98a-5e223f5bfb49 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:56.186877 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:56.187009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-20554bb6-0ba5-401f-8751-64da3c52c825 tempest-ServerRescueNegativeTestJSON-1907734826 tempest-ServerRescueNegativeTestJSON-1907734826-project] 10.222.0.52 "GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49" status: 404 len: 111 microversion: 2.1 time: 0.031349 Oct 10 12:04:56.187009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 367/742] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:56 2022] GET /compute/v2.1/servers/0079dd21-134c-4eba-b98a-5e223f5bfb49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:04:56.188608 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:56.189095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:56.189528 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:56.190221 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:56.190926 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:56.191120 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:56.206090 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] HTTP exception thrown: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Request method failure captured: Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 HTTP/1.1 Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAmWRhKfSfxrWDjSFGFQO-V8J7a5YG5iCNscvKRcr2QRMcvTKUHNeQWC9C9PXmtirl6tafmWdIohLON-9UHtQTMIUHCZVkrOCIs_dElA5d0Y1Zw3z0yQ3aYpT4_vIe_6LDUpWd0ZyMfrBMqbjmd7A7PA_KX8igGsIWgIM5EUV2F7Vr4 Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:04:56.207721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_638435e7c9ea431aa6ad3674ee6ff2ae", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}] Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestVolumeBootPattern-851235108 Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: ce6a1b5ca7584f90bfe83b73aff1335a Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:04:56.209372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '7c012add-b9da-448b-8444-af9e38053fc1'} Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:04:56.210342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:04:56.211844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:04:56.213174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Returning 404 to user: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:04:56.213174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c36f99c3-3da2-448f-a853-9f7723b45e63 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 404 len: 111 microversion: 2.1 time: 0.033029 Oct 10 12:04:56.213174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 376/743] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:56 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:04:56.310078 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1079327564", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-535509752", "security_groups": [{"name": "tempest-secgroup-smoke-1779695716"}], "block_device_mapping_v2": [{"uuid": "e79fea75-8384-4360-a1c0-328dd5d05b67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "099cba3b-5410-4f1b-a5a9-7c05259222ec"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:56.430268 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] validate_networks() for [('099cba3b-5410-4f1b-a5a9-7c05259222ec', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:04:56.579596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-2ebd0e9c-ded4-4014-939a-e81a58683c4a req-099b2545-951c-4c36-b136-d638c06191a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c012add-b9da-448b-8444-af9e38053fc1", "name": "network-vif-deleted", "tag": "c7ad4161-200b-4965-9f0e-a49f6ad3a6eb"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:56.589718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2ebd0e9c-ded4-4014-939a-e81a58683c4a req-099b2545-951c-4c36-b136-d638c06191a4 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:56.590230 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2ebd0e9c-ded4-4014-939a-e81a58683c4a req-099b2545-951c-4c36-b136-d638c06191a4 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:56.590659 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2ebd0e9c-ded4-4014-939a-e81a58683c4a req-099b2545-951c-4c36-b136-d638c06191a4 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:56.601927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-2ebd0e9c-ded4-4014-939a-e81a58683c4a req-099b2545-951c-4c36-b136-d638c06191a4 service nova] Creating event network-vif-deleted:c7ad4161-200b-4965-9f0e-a49f6ad3a6eb for instance 7c012add-b9da-448b-8444-af9e38053fc1 on hv-cinder-85061 Oct 10 12:04:56.607637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-2ebd0e9c-ded4-4014-939a-e81a58683c4a req-099b2545-951c-4c36-b136-d638c06191a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Oct 10 12:04:56.608595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 377/744] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:04:56.846468 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:04:56.846928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:04:56.847403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:04:56.847802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:04:56.848222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:04:56.856932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:56.857408 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:56.857836 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:56.858551 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:56.859030 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:56.859452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:56.875698 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:04:56.879683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for user ce6a1b5ca7584f90bfe83b73aff1335a and project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:04:56.936805 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:04:56.938924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e79fea75-8384-4360-a1c0-328dd5d05b67',volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:04:57.068894 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d784bf9-d85e-4926-ab97-efe93524fd70 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762845 Oct 10 12:04:57.069546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 368/745] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:04:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:04:57.082006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f1aa0497-5466-4d8c-ae37-78e26d685a54 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:57.082706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f1aa0497-5466-4d8c-ae37-78e26d685a54 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:57.139209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f1aa0497-5466-4d8c-ae37-78e26d685a54 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:57.147149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f1aa0497-5466-4d8c-ae37-78e26d685a54 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1094 microversion: 2.1 time: 0.069356 Oct 10 12:04:57.168043 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 378/746] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:57 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:58.183872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:58.186199 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:58.195173 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:58.195997 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:58.196664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:58.198246 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:58.198936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:58.199578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:58.267183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:58.279401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd419faa-340f-47ef-b97b-348f1268769d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1192 microversion: 2.1 time: 0.100042 Oct 10 12:04:58.280678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 369/747] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:58 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:04:59.306575 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:04:59.307361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:59.317082 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:59.317674 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:59.318188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:59.319004 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:59.319568 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:59.325323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:59.611636 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:04:59.620144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-721790d6-86f3-4354-9c0e-6d1bd6afe028 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.317734 Oct 10 12:04:59.633145 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 379/748] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:04:59 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:00.279346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-f0e61845-b37b-43a8-95ac-fbdc3894a3ac req-ff5b81e1-20e4-44d1-8d21-4c199ae7f71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce88a43d-b7f1-4e69-b06b-038752ead6d9", "tag": "612b5334-2c73-4495-a917-6e51b705efde"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:00.292874 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f0e61845-b37b-43a8-95ac-fbdc3894a3ac req-ff5b81e1-20e4-44d1-8d21-4c199ae7f71c service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:00.293875 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f0e61845-b37b-43a8-95ac-fbdc3894a3ac req-ff5b81e1-20e4-44d1-8d21-4c199ae7f71c service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:00.294403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f0e61845-b37b-43a8-95ac-fbdc3894a3ac req-ff5b81e1-20e4-44d1-8d21-4c199ae7f71c service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:00.310647 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-f0e61845-b37b-43a8-95ac-fbdc3894a3ac req-ff5b81e1-20e4-44d1-8d21-4c199ae7f71c service nova] Creating event network-changed:612b5334-2c73-4495-a917-6e51b705efde for instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 on hv-cinder-85061 Oct 10 12:05:00.317091 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-f0e61845-b37b-43a8-95ac-fbdc3894a3ac req-ff5b81e1-20e4-44d1-8d21-4c199ae7f71c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042726 Oct 10 12:05:00.317817 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 370/749] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:00.644285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:00.645007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:00.652144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:00.652638 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:00.653268 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:00.654134 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:00.654769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:00.655631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:00.829873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:00.843308 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-11cc548c-b4b7-4298-a2c6-6e1818850ac6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.202719 Oct 10 12:05:00.844016 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 380/750] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:00 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:01.866593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:01.867334 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:01.873695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:01.874181 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:01.874621 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:01.875347 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:01.875808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:01.876231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:02.017599 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:02.026604 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c3b62eba-6650-4e30-bc78-862bdbf63622 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.164625 Oct 10 12:05:02.027211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 371/751] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:01 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:03.049005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:03.049889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:03.056668 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:03.057185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:03.057620 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:03.058315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:03.058850 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:03.059325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:03.193254 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:03.201793 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-23ea7e1e-4934-4761-8a67-19f3361f3d27 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.156545 Oct 10 12:05:03.202373 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 381/752] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:03 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:04.224736 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:04.225381 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:04.231876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:04.232474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:04.232936 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:04.233619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:04.234079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:04.234505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:04.372042 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:04.379921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-93e45984-e435-4330-8f04-5fa21887b8e3 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.159210 Oct 10 12:05:04.380484 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 372/753] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:04 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:04.920108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:04.920843 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:04.926977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:04.927460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:04.927898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:04.928586 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:04.929050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:04.929473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:04.952633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cce7fe88-89fe-4c72-b554-658603f91ea1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/ips" status: 200 len: 152 microversion: 2.20 time: 0.210131 Oct 10 12:05:04.953187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 382/754] 10.222.0.52 () {60 vars in 1289 bytes} [Mon Oct 10 12:05:04 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/ips => generated 152 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:05:05.402115 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:05.402707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:05.409813 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:05.410303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:05.410745 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:05.411660 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:05.412125 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:05.412552 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:05.556104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:05.563820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-40858d17-2faa-45af-b8f3-7b4ef95c775f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.166140 Oct 10 12:05:05.564384 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 373/755] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:05 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:06.251343 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:06.251844 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:06.258280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.258768 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.259800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.260489 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.260940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.261361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.286378 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-545700c2-a080-41bf-90f9-34c0ba86b5b3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/ips" status: 200 len: 146 microversion: 2.1 time: 0.038976 Oct 10 12:05:06.287490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 383/756] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:05:06 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:06.589419 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:06.590169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:06.600044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.600807 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.601341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.602224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.603932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.604598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.745634 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:06.754047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5c7fe074-4a95-4eed-ad5e-53b67010d829 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.172380 Oct 10 12:05:06.754643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 374/757] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:06 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:06.880474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:06.881127 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:06.887581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.888096 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.888599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.889401 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.889928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.890367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.904403 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:06.915146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lazy-loading 'flavor' on Instance uuid 1e69a02d-e65e-499c-b917-0848603db0b7 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:05:07.124160 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f351bfde-150e-469f-8ceb-423406ac83da tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/action" status: 202 len: 0 microversion: 2.20 time: 0.246693 Oct 10 12:05:07.124767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 384/758] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Oct 10 12:05:06 2022] POST /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:05:07.134273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:07.135290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:07.143092 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:07.144506 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:07.146242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.146783 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.147455 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.148628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.149135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.149654 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.293433 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:07.301972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:07.303450 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:07.304721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7f9d66df-af9a-405c-9d9f-2446bfecce5e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.174963 Oct 10 12:05:07.305311 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 375/759] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:07 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:07.644678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:07.650168 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6716b0e-f6ee-401d-a2f5-62b1d1ddae01"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:07.652731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:07.659138 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.659624 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.660062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.660745 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.661204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.661628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.776688 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:07.777302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:07.783788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.784278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.784720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.785417 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.785879 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.786311 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.804737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:07.920998 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:07.929550 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e646c157-8006-48f0-8f7b-e9a653c85590 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.156671 Oct 10 12:05:07.930121 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 376/760] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:07 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:05:07.947709 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7569d25e-8bef-42b9-9173-192f7002b314 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303658 Oct 10 12:05:07.948315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 385/761] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:05:07 2022] POST /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:08.331013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:08.331657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:08.333491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:08.339383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:08.339872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:08.340309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:08.341006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:08.341463 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:08.341890 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:08.481404 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:08.489642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:08.491171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:08.492335 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f75819a8-2777-4482-8b57-88232defa2e1 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.165299 Oct 10 12:05:08.492929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 377/762] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:08 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:08.954546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:08.955292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:08.961863 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:08.963093 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:08.963652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:08.964598 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:08.964947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:08.965555 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:09.096869 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:09.104468 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a2064510-3761-4458-a0c8-b2ce2ee9913e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.154514 Oct 10 12:05:09.105031 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 386/763] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:08 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:09.518014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:09.518623 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:09.525198 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:09.525677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:09.526113 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:09.526813 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:09.527279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:09.527703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:09.656150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:09.664139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:09.666086 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:09.667275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2503ddfe-6c9f-48c7-bca0-b330b37a7fff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.153146 Oct 10 12:05:09.667832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 378/764] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:09 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:10.127707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:10.129053 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:10.145780 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:10.146559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:10.147319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:10.148626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:10.149471 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:10.150403 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:10.311374 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:10.323069 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dc6afff6-255b-453a-b6b9-3cdf3740c974 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.198402 Oct 10 12:05:10.327707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 387/765] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:10 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:10.395497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-360a4417-d56e-4657-addd-ea2e0c52b147 req-8f13e6a8-3edb-490a-a27c-bbf32f404d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce88a43d-b7f1-4e69-b06b-038752ead6d9", "name": "network-vif-plugged", "status": "completed", "tag": "612b5334-2c73-4495-a917-6e51b705efde"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:10.409914 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-360a4417-d56e-4657-addd-ea2e0c52b147 req-8f13e6a8-3edb-490a-a27c-bbf32f404d2e service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:10.410407 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-360a4417-d56e-4657-addd-ea2e0c52b147 req-8f13e6a8-3edb-490a-a27c-bbf32f404d2e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:10.410838 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-360a4417-d56e-4657-addd-ea2e0c52b147 req-8f13e6a8-3edb-490a-a27c-bbf32f404d2e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:10.427372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-360a4417-d56e-4657-addd-ea2e0c52b147 req-8f13e6a8-3edb-490a-a27c-bbf32f404d2e service nova] Creating event network-vif-plugged:612b5334-2c73-4495-a917-6e51b705efde for instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 on hv-cinder-85061 Oct 10 12:05:10.433002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-360a4417-d56e-4657-addd-ea2e0c52b147 req-8f13e6a8-3edb-490a-a27c-bbf32f404d2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187079 Oct 10 12:05:10.433609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 379/766] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:10.693094 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:10.693718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:10.700682 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:10.701179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:10.701623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:10.702325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:10.702789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:10.703255 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:10.903769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:10.913274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:10.916114 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:10.917417 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-537725de-72e5-4d9d-8395-85802dec42fa tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.228418 Oct 10 12:05:10.918332 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 388/767] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:10 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:11.346568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:11.347402 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:11.354301 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:11.354792 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:11.355254 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:11.355960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:11.356481 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:11.356910 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:11.524243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:11.532660 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b6f4bcb2-685f-4b25-8b6c-3f6dcf6add0f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1266 microversion: 2.1 time: 0.190886 Oct 10 12:05:11.533233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 380/768] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:11 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:11.945287 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:11.946150 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:11.963889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:11.964535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:11.965749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:11.966616 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:11.967209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:11.967718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:12.113472 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:12.121752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:12.123252 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:12.124407 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1ef18bd9-fd91-4a62-95de-c60bd2609610 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.183758 Oct 10 12:05:12.125174 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 389/769] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:11 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:12.555186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:12.555836 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:12.562246 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:12.562734 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:12.563465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:12.563906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:12.564367 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:12.564797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:12.699081 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:12.707285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2019bae4-06e8-4dbe-a01c-e2780d112d33 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1454 microversion: 2.1 time: 0.155929 Oct 10 12:05:12.707948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 381/770] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:12 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:12.729894 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:12.730519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:12.736464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:12.736951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:12.737394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:12.738092 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:12.738550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:12.739011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:12.873531 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:12.881406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8f3cc39b-d591-4707-85af-23990c245476 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1454 microversion: 2.1 time: 0.155442 Oct 10 12:05:12.881967 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 390/771] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:12 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:13.150227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:13.151033 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:13.160135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:13.160625 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:13.161050 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:13.161927 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:13.162388 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:13.162849 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:13.315574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:13.329767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:13.333722 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:13.335470 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-55efbeb5-8e9f-4666-97bf-7a5d1f8a0ec5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.189515 Oct 10 12:05:13.344221 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 382/772] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:13 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:14.361948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:14.362729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:14.369562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:14.370209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:14.370753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:14.371732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:14.372274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:14.372815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:14.502770 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:14.510814 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:14.512285 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:14.513442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-82cb82ee-617b-4d72-98a2-8670c27b1a4a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.155547 Oct 10 12:05:14.514003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 391/773] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:14 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:14.854872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-6d4e92fb-abbd-4696-b76f-d5454d9303f1 req-ce775870-b65d-4904-8c21-a8756291846b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce88a43d-b7f1-4e69-b06b-038752ead6d9", "tag": "612b5334-2c73-4495-a917-6e51b705efde"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:14.864710 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6d4e92fb-abbd-4696-b76f-d5454d9303f1 req-ce775870-b65d-4904-8c21-a8756291846b service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:14.865192 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6d4e92fb-abbd-4696-b76f-d5454d9303f1 req-ce775870-b65d-4904-8c21-a8756291846b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:14.865626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6d4e92fb-abbd-4696-b76f-d5454d9303f1 req-ce775870-b65d-4904-8c21-a8756291846b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:14.882324 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-6d4e92fb-abbd-4696-b76f-d5454d9303f1 req-ce775870-b65d-4904-8c21-a8756291846b service nova] Creating event network-changed:612b5334-2c73-4495-a917-6e51b705efde for instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 on hv-cinder-85061 Oct 10 12:05:14.887888 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-6d4e92fb-abbd-4696-b76f-d5454d9303f1 req-ce775870-b65d-4904-8c21-a8756291846b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164548 Oct 10 12:05:14.888562 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 383/774] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:15.539128 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:15.539775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:15.550352 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:15.550839 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:15.551538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:15.551797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:15.552256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:15.552739 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:15.553192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:15.554593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:15.562353 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:15.562877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:15.563355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:15.564525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:15.564991 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:15.565422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:15.596266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f3baaa33-895f-4c7c-9680-b3a6f4642b05 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054266 Oct 10 12:05:15.596845 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 384/775] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:15 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:15.610210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:15.610825 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:15.617668 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:15.618874 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:15.619667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:15.620549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:15.621108 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:15.621605 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:15.652620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f0dcc32f-b713-46a4-a563-3b584760f5ca tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/f6716b0e-f6ee-401d-a2f5-62b1d1ddae01" status: 200 len: 194 microversion: 2.1 time: 0.046702 Oct 10 12:05:15.653072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 385/776] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Oct 10 12:05:15 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/f6716b0e-f6ee-401d-a2f5-62b1d1ddae01 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:05:15.700435 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:15.708704 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:15.710136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:15.711587 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8ea6d4c0-2290-4b7a-b366-8d32eb81d51a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.176651 Oct 10 12:05:15.712177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 392/777] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:15 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:16.737709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:16.738315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:16.746440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:16.746972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:16.747418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:16.748309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:16.748782 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:16.749213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:16.905094 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:16.915708 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:16.917218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:16.918928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cc6e9f70-0591-4b90-b809-097d3dad6dd8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.185113 Oct 10 12:05:16.919491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 386/778] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:16 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:17.003454 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e571251-10a6-4102-ba4f-876747904884"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:17.007420 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:17.015149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:17.015828 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:17.016204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:17.016911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:17.017371 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:17.017823 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:17.357930 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d71da74-49f8-4090-87d9-d64a7afc462d tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "POST /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358522 Oct 10 12:05:17.358587 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 393/779] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:05:16 2022] POST /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:17.945485 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:17.946264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:17.952839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:17.953326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:17.953956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:17.954656 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:17.955175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:17.955603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:18.110305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:18.122395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:18.123985 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:18.125291 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9f35fe3b-ce2d-442b-9cc1-49a1a1553087 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.184670 Oct 10 12:05:18.126119 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 387/780] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:17 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:19.152447 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:19.153076 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:19.155604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:19.161097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:19.161583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:19.162013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:19.162709 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:19.163189 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:19.163611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:19.305920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:19.314523 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:19.316021 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:19.317191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ac019576-6f2c-4fab-9f12-5b607e8b67e4 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.169601 Oct 10 12:05:19.317753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 394/781] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:19 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:20.343964 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:20.344717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:20.350558 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:20.351085 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:20.351529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:20.352232 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:20.352694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:20.353122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:20.481364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:20.489395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:20.490830 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:20.492017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-705e1e4e-bd1a-45db-a4c3-1fa1ce55f00a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.152913 Oct 10 12:05:20.492587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 388/782] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:20 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:21.517333 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:21.517946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:21.524384 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:21.524868 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:21.525306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:21.525989 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:21.526445 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:21.526869 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:21.656711 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:21.664746 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:21.666841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:21.668019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-25776333-29f2-45f0-be3a-4c92ea66690b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.154637 Oct 10 12:05:21.668579 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 395/783] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:21 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:22.693488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:22.694217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:22.706049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:22.706049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:22.706049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:22.706049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:22.706525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:22.706525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:22.849797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:22.858390 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:22.859777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:22.860928 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e41a4004-73de-4954-b289-75029f9f1cc5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.171324 Oct 10 12:05:22.861824 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 389/784] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:22 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:23.887572 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:23.888178 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:23.894498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:23.895010 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:23.895447 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:23.896140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:23.896591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:23.897013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:23.912725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:24.028807 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:24.036706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:24.038175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:24.039361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8f9df6f3-7ce3-4079-b777-88e3fdce83e9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.156249 Oct 10 12:05:24.039927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 396/785] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:23 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:24.487262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:24.487895 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:24.494059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:24.494543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:24.495001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:24.495696 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:24.496149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:24.496578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:24.520268 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7344eb2d-cafe-41c1-b78b-f4ff0fa989ef tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/ips" status: 200 len: 150 microversion: 2.1 time: 0.036771 Oct 10 12:05:24.520852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 390/786] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:05:24 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:24.964525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:24.967003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:24.973439 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:24.974058 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:24.975154 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:24.975856 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:24.976317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:24.976746 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.008555 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8861e3a9-3975-4581-b931-087d773dc346 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048748 Oct 10 12:05:25.010068 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 397/787] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:24 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:25.064976 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:25.066174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:25.072098 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.072586 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.073024 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.073719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.074179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.074704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.167752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:25.168290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:25.174573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.175131 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.175572 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.176911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.177386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.177817 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.210264 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dc1d827f-2692-4419-aa1b-ac99aa197a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/f6716b0e-f6ee-401d-a2f5-62b1d1ddae01" status: 200 len: 194 microversion: 2.1 time: 0.047038 Oct 10 12:05:25.214382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:25.215049 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 398/788] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Oct 10 12:05:25 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/f6716b0e-f6ee-401d-a2f5-62b1d1ddae01 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:25.222239 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:25.222754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:25.224022 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:25.225881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:25.227664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e09ed1a3-4691-4ce8-a6e0-a07fa1d95737 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.166048 Oct 10 12:05:25.228491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 391/789] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:25 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:25.229815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.230319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.230765 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.231510 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.231975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.232410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.316943 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lazy-loading 'services' on Instance uuid 6684b0b5-2c8b-4650-9955-769f646d7173 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:05:25.392600 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d9ad7fe7-41b2-4c55-a67d-c0e99bfdf6a5 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/f6716b0e-f6ee-401d-a2f5-62b1d1ddae01" status: 202 len: 0 microversion: 2.1 time: 0.174879 Oct 10 12:05:25.393209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 399/790] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:05:25 2022] DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/f6716b0e-f6ee-401d-a2f5-62b1d1ddae01 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:05:25.899924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "577a0462-308b-45f0-956a-8e681dd30803"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:25.902406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:25.908784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.909259 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.909688 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:25.910379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:25.910831 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:25.911350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:26.255080 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:26.255811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:26.262582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:26.263191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:26.263699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:26.264462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:26.264990 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:26.265451 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:26.416579 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:26.425369 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:26.426791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:26.427985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-83c9ea23-b41d-4871-94ce-3466a244111e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.178100 Oct 10 12:05:26.428513 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 400/791] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:26 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:26.559892 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-41375a5c-1e6b-467d-b33c-478cd3e3107b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "POST /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662671 Oct 10 12:05:26.561188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 392/792] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:05:25 2022] POST /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:27.458570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:27.459345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:27.466350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:27.466920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:27.467446 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:27.468239 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:27.468759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:27.469247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:27.600260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:27.608545 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:27.609971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:27.611148 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f09e53de-7f47-46f3-92a0-12605e518d82 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.156455 Oct 10 12:05:27.611703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 401/793] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:27 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:27.659816 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:27.660966 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:27.668218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:27.668713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:27.669156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:27.669866 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:27.670324 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:27.671081 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:27.690273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:27.707395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c9a9ab98-0eb3-48ad-a806-2836659e0b68 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/2e571251-10a6-4102-ba4f-876747904884" status: 200 len: 194 microversion: 2.1 time: 0.052617 Oct 10 12:05:27.707972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 393/794] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Oct 10 12:05:27 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/2e571251-10a6-4102-ba4f-876747904884 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:27.723284 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:27.723812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:27.729698 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:27.730183 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:27.730620 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:27.731336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:27.731798 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:27.732229 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:27.812332 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lazy-loading 'services' on Instance uuid 6684b0b5-2c8b-4650-9955-769f646d7173 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:05:27.885144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0ac926f-fd46-46b2-ab9a-bd59d60a74aa tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/2e571251-10a6-4102-ba4f-876747904884" status: 202 len: 0 microversion: 2.1 time: 0.165674 Oct 10 12:05:27.885827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 402/795] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:05:27 2022] DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments/2e571251-10a6-4102-ba4f-876747904884 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:05:28.638585 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:28.639445 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:28.646187 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:28.646683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:28.647173 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:28.647841 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:28.648302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:28.648798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:29.067995 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:29.076565 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:29.078013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:29.079208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b3be3a38-34ee-4f94-9031-bd7d89e32964 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.445519 Oct 10 12:05:29.079759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 394/796] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:28 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:30.106998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:30.107791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:30.118793 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:30.119169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1894810672", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "networks": [{"uuid": "b924ba9b-07bb-4c95-8c7c-b804d947af19"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:30.119676 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:30.120531 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:30.121329 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:30.121800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:30.122234 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:30.172365 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] validate_networks() for [('b924ba9b-07bb-4c95-8c7c-b804d947af19', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:05:30.332331 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:30.341598 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:30.343078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:30.344247 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1977ecd5-0abf-488f-94b8-08598b23ff2d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.243447 Oct 10 12:05:30.344810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 403/797] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:30 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:30.566671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:05:30.567133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:05:30.567608 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:05:30.568015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:05:30.568430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:05:30.577704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:30.578185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:30.578617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:30.579381 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:30.579890 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:30.580266 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:30.597015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Getting quotas for project 0223b57233664d0785c96ec98335e307. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:05:30.600902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Getting quotas for user 0243f437de8b439984375303ff49f9e3 and project 0223b57233664d0785c96ec98335e307. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:05:30.611657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:05:30.613913 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:05:30.659077 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-25840123-9a4c-4f64-901d-8aa41cc903e5 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543815 Oct 10 12:05:30.659713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 395/798] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:05:30.670633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7a504ddf-ca4e-45f1-80fc-aafdd8cae962 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:30.671272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7a504ddf-ca4e-45f1-80fc-aafdd8cae962 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:30.728691 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a504ddf-ca4e-45f1-80fc-aafdd8cae962 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:30.736490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7a504ddf-ca4e-45f1-80fc-aafdd8cae962 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1219 microversion: 2.1 time: 0.068629 Oct 10 12:05:30.736490 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 404/799] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:30 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:31.370036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:31.370681 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:31.377659 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:31.378136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:31.378582 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:31.379311 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:31.379773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:31.380204 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:31.518076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:31.526154 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:31.527624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:31.528785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-574ae2b8-ec9b-4487-9108-d506ecccbdff tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.163232 Oct 10 12:05:31.529338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 396/800] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:31 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:31.759863 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:31.760381 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:31.767898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:31.768387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:31.768820 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:31.769505 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:31.769985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:31.770409 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:31.832127 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:31.839830 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bfe8bdaf-b9b3-44aa-b868-39e8ded558cc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1271 microversion: 2.1 time: 0.084339 Oct 10 12:05:31.840407 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 405/801] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:31 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:32.553918 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:32.554621 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:32.561888 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:32.562385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:32.562911 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:32.563669 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:32.564232 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:32.565080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:32.701496 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:32.709503 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:32.710965 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:32.712126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8d2aa3ec-8b84-4569-9327-180ff72535bc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.162150 Oct 10 12:05:32.712685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 397/802] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:32 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:32.865199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:32.865818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:32.872747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:32.873240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:32.873679 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:32.874377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:32.874835 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:32.875303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:33.144450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:33.154334 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d1ad494c-95c4-4367-aba0-f7469ac7ab06 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.292408 Oct 10 12:05:33.155044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 406/803] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:32 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:33.543366 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-6add4332-6e8d-49c5-89b8-4217b9d13993 req-70beaeb3-9e31-41d0-8b8b-08f752d84ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb", "tag": "a90332e5-ecc6-46bf-b01f-c3ef0160a937"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:33.553122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6add4332-6e8d-49c5-89b8-4217b9d13993 req-70beaeb3-9e31-41d0-8b8b-08f752d84ac3 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:33.553605 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6add4332-6e8d-49c5-89b8-4217b9d13993 req-70beaeb3-9e31-41d0-8b8b-08f752d84ac3 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:33.554039 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-6add4332-6e8d-49c5-89b8-4217b9d13993 req-70beaeb3-9e31-41d0-8b8b-08f752d84ac3 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:33.564674 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-6add4332-6e8d-49c5-89b8-4217b9d13993 req-70beaeb3-9e31-41d0-8b8b-08f752d84ac3 service nova] Creating event network-changed:a90332e5-ecc6-46bf-b01f-c3ef0160a937 for instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb on hv-cinder-85061 Oct 10 12:05:33.569356 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-6add4332-6e8d-49c5-89b8-4217b9d13993 req-70beaeb3-9e31-41d0-8b8b-08f752d84ac3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029746 Oct 10 12:05:33.570123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 398/804] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:33.737702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:33.738324 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:33.744954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:33.745446 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:33.745891 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:33.746593 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:33.747122 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:33.747552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:33.956228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:33.965450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:33.966911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:33.968171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a655ef1a-1e97-421a-b737-6f8bb34006ea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.234371 Oct 10 12:05:33.968726 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 407/805] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:33 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:34.178864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.179740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:34.188970 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.189774 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.190420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.191337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.192115 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.192909 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.270127 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.270919 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:34.276805 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.277283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.277715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.278399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.278852 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.279298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.366597 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lazy-loading 'services' on Instance uuid 306c1542-d247-4dee-84ff-b93cf2e010c7 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:05:34.438842 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:34.447154 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c0b0768d-4d91-4dba-b9fc-6f78d491d1e6 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments/577a0462-308b-45f0-956a-8e681dd30803" status: 202 len: 0 microversion: 2.1 time: 0.181145 Oct 10 12:05:34.447815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 408/806] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:05:34 2022] DELETE /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments/577a0462-308b-45f0-956a-8e681dd30803 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:05:34.448460 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-87717fdd-1dc0-4131-acf3-c7965cc1d2c6 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.274432 Oct 10 12:05:34.464598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 399/807] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:34 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:34.464784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.464784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:34.464996 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.464996 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:34.466494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.467546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.468002 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.468714 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.469751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.469875 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.470256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.470387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.470848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.471806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.472625 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.472986 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.503478 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f1c15d7b-02eb-4b00-9290-f45a8e593034 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054221 Oct 10 12:05:34.504041 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 409/808] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:34 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:05:34.507002 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-87cefffb-a19f-4ef7-91b6-4358b82c7e7a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051128 Oct 10 12:05:34.507551 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 400/809] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:34 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:34.621993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.624227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:34.630064 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.630550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.631017 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.631712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.632175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.632608 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.660959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6cd71a9b-7b07-43c7-a99a-8e9a70fcced4 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043387 Oct 10 12:05:34.661527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 410/810] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:34 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:05:34.724395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.724873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:34.731190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.731667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.732099 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.732777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.733285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.733707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.759721 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:05:34.832869 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-092ac674-1d83-4e32-85ea-52b703f0d7ab tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 204 len: 0 microversion: 2.1 time: 0.112203 Oct 10 12:05:34.833439 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 401/811] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:34 2022] DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:05:34.841569 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.842197 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:34.847989 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.848473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.848913 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.849604 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:34.850064 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:34.850491 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:34.984796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:34.992629 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4cc17646-bef5-4e7c-b75f-d548b37d87db tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1674 microversion: 2.1 time: 0.154903 Oct 10 12:05:34.993752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 411/812] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:34 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:34.994288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:34.995140 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:35.001081 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:35.001563 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:35.002006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:35.002738 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:35.003225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:35.003663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:35.134840 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:35.142993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:35.144441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:35.145596 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-936a9630-6e64-4989-953d-a011feeab432 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.156310 Oct 10 12:05:35.146160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 402/813] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:34 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:35.471373 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:35.471993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:35.477976 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:35.478467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:35.478939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:35.479643 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:35.480104 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:35.480538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:35.483177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:35.521350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:35.523571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:35.529505 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:35.529992 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:35.530432 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:35.531157 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:35.531624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:35.532055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:35.562147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8f9fcbb9-f573-4314-af6f-6318a2b6f6e7 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Oct 10 12:05:35.562716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 403/814] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:35 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:05:35.608366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:35.615978 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-17faebc9-aac3-4c66-9a57-6b4d72069b14 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.148472 Oct 10 12:05:35.616552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 412/815] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:35 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:36.016920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:36.017544 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:36.024518 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.025008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.025451 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.026145 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.026612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.027079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.160920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:36.171117 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-62b026dc-8e49-4ad9-84d3-187d0e6f88fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1674 microversion: 2.1 time: 0.158042 Oct 10 12:05:36.171477 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:36.171944 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 404/816] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:36 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:36.172326 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:36.179050 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.179535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.179971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.180701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.181156 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.181580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.309557 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:36.317498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:36.319002 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:36.320172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6db10909-ceac-4acd-b4a9-1e1dc6e75bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.152600 Oct 10 12:05:36.320732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 413/817] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:36 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:36.575224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:36.577443 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:36.583387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.583887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.584320 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.584999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.585452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.585871 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.614784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-04253f00-2bfd-4e51-8328-a26845d5429a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044102 Oct 10 12:05:36.615352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 405/818] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:36 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:36.639534 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:36.640149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:36.645970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.646448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.646917 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.647590 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:36.648041 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:36.648459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:36.775719 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:36.783176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-67a71d1c-169e-4292-9ef0-15b6e11d1df9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.147368 Oct 10 12:05:36.783734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 414/819] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:36 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:37.194754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:37.195392 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:37.202189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.202671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.203137 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.204048 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.204491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.205090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.331065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:37.339288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46c4247a-86d5-41c0-bfc7-8a55bc2fc0e3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1674 microversion: 2.1 time: 0.148339 Oct 10 12:05:37.339842 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 406/820] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:37 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:37.345515 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:37.346133 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:37.352542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.353027 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.353470 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.354169 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.354633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.355095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.481197 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:37.489211 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:37.490684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:37.491862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c88d8437-3028-4fa5-a6be-7af5b75f8721 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.150248 Oct 10 12:05:37.492419 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 415/821] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:37 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:37.627180 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:37.629368 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:37.636181 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.636667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.637107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.637797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.638257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.638684 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.668290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-397c0d66-d864-47e4-a1d7-3517f2650a8a tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Oct 10 12:05:37.668835 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 407/822] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:37 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:37.805634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:37.806172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:37.812140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.812624 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.813067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.813752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:37.814207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:37.814630 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:37.959644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:37.967157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d2782aa-f58e-482a-9fa1-e9b999930bee tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.165424 Oct 10 12:05:37.967722 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 416/823] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:37 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:38.361992 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:38.362606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:38.369421 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.369909 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.370346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.371186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.372105 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.372535 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.517711 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:38.518484 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:38.525171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.525732 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.526244 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.527061 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.527578 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.528115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.650726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:38.658787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8e1c130f-cd8a-49fe-9ac4-51ee09561ad3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1674 microversion: 2.1 time: 0.300875 Oct 10 12:05:38.671483 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 408/824] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:38 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1674 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:38.681444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:38.683703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:38.686740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:38.690612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.691133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.691570 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.692275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.692735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.693171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.718629 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:38.722950 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bae7b179-16c1-43a9-92d2-18062c659fce tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045903 Oct 10 12:05:38.723530 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 409/825] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Oct 10 12:05:38 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:05:38.773942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:38.782176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:38.783914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:38.785201 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a06f47bb-ab6f-4127-bd52-8de94a9954e3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1745 microversion: 2.20 time: 0.271449 Oct 10 12:05:38.785838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 417/826] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:38 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1745 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:38.788856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:38.789359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:38.797287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.797773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.798206 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.799197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.799701 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.800131 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.825920 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:05:38.932273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7f641992-726d-4317-b178-7401f6b6c1fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 204 len: 0 microversion: 2.1 time: 0.147118 Oct 10 12:05:38.934211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 410/827] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:38 2022] DELETE /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:05:38.955203 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:38.960761 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:38.975672 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.976204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.976883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.981452 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:38.982321 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:38.984486 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:38.990171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:38.990903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:39.005444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.006453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.007263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.008148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.008798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.009394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.220342 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:39.229770 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-db303652-d1ac-4602-a944-df27a273b7a0 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1679 microversion: 2.1 time: 0.290595 Oct 10 12:05:39.230728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 418/828] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:38 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1679 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:39.239181 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-e0c54eb4-df7c-43af-9ce2-bc795cd487f1 req-7e405221-0498-4883-8513-87c886df9277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6684b0b5-2c8b-4650-9955-769f646d7173", "name": "network-vif-deleted", "tag": "099a0b78-937e-408f-b139-3ca52765679d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:39.244308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:39.254599 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e0c54eb4-df7c-43af-9ce2-bc795cd487f1 req-7e405221-0498-4883-8513-87c886df9277 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.255406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e0c54eb4-df7c-43af-9ce2-bc795cd487f1 req-7e405221-0498-4883-8513-87c886df9277 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.256358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e0c54eb4-df7c-43af-9ce2-bc795cd487f1 req-7e405221-0498-4883-8513-87c886df9277 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.257329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-011a04be-2915-41fa-a2d4-4c637e6083fd tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.270628 Oct 10 12:05:39.268443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-e0c54eb4-df7c-43af-9ce2-bc795cd487f1 req-7e405221-0498-4883-8513-87c886df9277 service nova] Creating event network-vif-deleted:099a0b78-937e-408f-b139-3ca52765679d for instance 6684b0b5-2c8b-4650-9955-769f646d7173 on hv-cinder-85061 Oct 10 12:05:39.268620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 411/829] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:38 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:39.274877 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-e0c54eb4-df7c-43af-9ce2-bc795cd487f1 req-7e405221-0498-4883-8513-87c886df9277 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041106 Oct 10 12:05:39.275788 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 419/830] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:39.684244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:39.684862 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:39.691502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.691993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.692583 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.693440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.693901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.694329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.757628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:39.766041 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1ea5adf5-3d9f-4262-99fe-c82960d29159 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1606 microversion: 2.1 time: 0.085828 Oct 10 12:05:39.766624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 412/831] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:39 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:39.812698 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:39.813414 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:39.819636 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.820132 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.820581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.821897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.822359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.822790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.957504 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:39.965501 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:39.966985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:39.968156 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e9605e1e-0f2d-4af5-b0c6-c84aa62d8b98 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1745 microversion: 2.20 time: 0.160281 Oct 10 12:05:39.968718 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 420/832] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:39 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:40.253316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:40.253939 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:40.260055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.260541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.261197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.261667 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.262126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.262666 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.281501 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:40.282476 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:40.288355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.289102 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.290279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.291231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.291893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.292399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.480665 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:40.491062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7f2582ba-c4d3-45a2-84d3-4398a49f90b0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.213728 Oct 10 12:05:40.491645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 421/833] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:40 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:05:40.496761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:40.516032 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eed3962d-dd73-4901-a668-4a3e9712f6fc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1679 microversion: 2.1 time: 0.266481 Oct 10 12:05:40.516630 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 413/834] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:40 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:40.573972 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a7730a39-8672-4c7e-b43f-b153b59f76f8 req-00cc5230-a05b-4160-9527-eb0349a217f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb", "name": "network-vif-plugged", "status": "completed", "tag": "a90332e5-ecc6-46bf-b01f-c3ef0160a937"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:40.583270 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a7730a39-8672-4c7e-b43f-b153b59f76f8 req-00cc5230-a05b-4160-9527-eb0349a217f2 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.583761 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a7730a39-8672-4c7e-b43f-b153b59f76f8 req-00cc5230-a05b-4160-9527-eb0349a217f2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.584197 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a7730a39-8672-4c7e-b43f-b153b59f76f8 req-00cc5230-a05b-4160-9527-eb0349a217f2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.595876 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a7730a39-8672-4c7e-b43f-b153b59f76f8 req-00cc5230-a05b-4160-9527-eb0349a217f2 service nova] Creating event network-vif-plugged:a90332e5-ecc6-46bf-b01f-c3ef0160a937 for instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb on hv-cinder-85061 Oct 10 12:05:40.600942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a7730a39-8672-4c7e-b43f-b153b59f76f8 req-00cc5230-a05b-4160-9527-eb0349a217f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031656 Oct 10 12:05:40.601547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 422/835] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:40.790313 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:40.791084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:40.793014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:40.793706 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:40.800292 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.800788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.801232 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.801938 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.802399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.802832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.866714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0f1d116c004694b33b19d988ac4959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79aee39298624f99b33b9808fe5030f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:40.874755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4ff594b2-c985-499d-9e4a-5846dad29a93 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 200 len: 1322 microversion: 2.1 time: 0.088948 Oct 10 12:05:40.875372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 414/836] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:40 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 1322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:40.990612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:40.995721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:40.996422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:41.002832 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.003363 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.003782 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.004501 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.004968 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.005394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.514756 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:41.515583 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:41.521612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.522158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.522597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.523329 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.523788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.524574 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.556917 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:41.566872 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:41.568727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:41.570194 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-09991ab8-89b0-426b-8db8-2dd6bc39f754 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1745 microversion: 2.20 time: 0.580750 Oct 10 12:05:41.571360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 423/837] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:40 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1745 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:41.576879 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:41.577702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:41.584929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.585731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.586336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.587390 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.588016 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.588713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.849862 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:41.857497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3b390308-3d9a-442e-bd7f-6e477681bb4f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.347239 Oct 10 12:05:41.870914 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 415/838] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:41 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:41.897952 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:41.898569 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:41.905225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.905714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.906151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.906857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:41.907345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:41.907776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:41.910771 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:41.918596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b26558b8-cdd3-4ed0-b5d2-ede85a978346 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1679 microversion: 2.1 time: 0.345737 Oct 10 12:05:41.919329 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 424/839] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:41 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1679 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:41.928403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] HTTP exception thrown: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Request method failure captured: Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 HTTP/1.1 Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkYggKzXXAk8s2ortDGbjFjn7f7pZtctMXoY0WgpVBrTJqyAeqZpnoDw1gfjoa_kOXc-q4b02IVoPkXLWCvgq-WkA7hOjIOQk9rOtQGmRxhy-cIs5Ao-0HRJ3w0TF6nckzrct5J7s1H2RUTfEvtVbgDazDC4HeiNVOqn7dfj-qh3q0 Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:41.930242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79aee39298624f99b33b9808fe5030f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}] Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 0c0f1d116c004694b33b19d988ac4959 Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:41.931932 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '6684b0b5-2c8b-4650-9955-769f646d7173'} Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:41.932901 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:41.934529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:41.935993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Returning 404 to user: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:41.935993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a21543a0-428e-43c5-b61e-256ed70d6ed9 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 404 len: 111 microversion: 2.1 time: 0.041366 Oct 10 12:05:41.935993 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 416/840] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:41 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:05:41.944269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e34c4bbd-ebe8-497f-9f9d-adf47d4e09fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '.version_select at 0x7f862068c0d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:41.964478 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e34c4bbd-ebe8-497f-9f9d-adf47d4e09fe tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-912878582" status: 202 len: 0 microversion: 2.1 time: 0.023961 Oct 10 12:05:41.965351 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 425/841] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Oct 10 12:05:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-912878582 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:05:42.597649 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:42.598179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:42.614204 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:42.614706 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:42.615416 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:42.616471 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:42.616940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:42.617366 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:42.629337 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-d06bb0f9-7c07-4df9-b3bb-9f97c14d9d62 req-cdb64af1-b342-4ab6-8b5c-8dddd8fffb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e69a02d-e65e-499c-b917-0848603db0b7", "name": "network-vif-plugged", "status": "completed", "tag": "78c57fac-0497-4b6c-9eae-773ed6db62fe"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:42.662645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d06bb0f9-7c07-4df9-b3bb-9f97c14d9d62 req-cdb64af1-b342-4ab6-8b5c-8dddd8fffb5c service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:42.665888 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d06bb0f9-7c07-4df9-b3bb-9f97c14d9d62 req-cdb64af1-b342-4ab6-8b5c-8dddd8fffb5c service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:42.666680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d06bb0f9-7c07-4df9-b3bb-9f97c14d9d62 req-cdb64af1-b342-4ab6-8b5c-8dddd8fffb5c service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:42.702687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-d06bb0f9-7c07-4df9-b3bb-9f97c14d9d62 req-cdb64af1-b342-4ab6-8b5c-8dddd8fffb5c service nova] Creating event network-vif-plugged:78c57fac-0497-4b6c-9eae-773ed6db62fe for instance 1e69a02d-e65e-499c-b917-0848603db0b7 on hv-cinder-85061 Oct 10 12:05:42.710083 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-d06bb0f9-7c07-4df9-b3bb-9f97c14d9d62 req-cdb64af1-b342-4ab6-8b5c-8dddd8fffb5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084261 Oct 10 12:05:42.710970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 426/842] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:05:42.884587 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:42.885398 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:42.902411 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:42.904486 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:42.906282 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:42.907176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:42.910785 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:42.911576 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:42.991343 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:43.002320 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:43.004096 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:43.005869 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fdea8e72-1818-4ef3-b49e-b58dee4e6513 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.412213 Oct 10 12:05:43.019907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 417/843] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:42 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:43.027183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:43.028004 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:43.036259 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:43.036924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:43.037369 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:43.038166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:43.038624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:43.039440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:43.178580 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:43.187260 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-834e8088-5076-4b89-a917-aa42dfe8351b tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1613 microversion: 2.1 time: 0.166005 Oct 10 12:05:43.188115 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 418/844] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:43 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:43.193661 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-3a97691a-8ad5-4c9b-a5fb-6d8f4b19fd7d req-41289da5-10a8-4d4d-a833-ad263cd63a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306c1542-d247-4dee-84ff-b93cf2e010c7", "name": "network-vif-deleted", "tag": "ec05fa9f-369d-453e-9947-0e2f98a5821f"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:43.203587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3a97691a-8ad5-4c9b-a5fb-6d8f4b19fd7d req-41289da5-10a8-4d4d-a833-ad263cd63a3d service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:43.204628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3a97691a-8ad5-4c9b-a5fb-6d8f4b19fd7d req-41289da5-10a8-4d4d-a833-ad263cd63a3d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:43.205345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3a97691a-8ad5-4c9b-a5fb-6d8f4b19fd7d req-41289da5-10a8-4d4d-a833-ad263cd63a3d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:43.221622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-3a97691a-8ad5-4c9b-a5fb-6d8f4b19fd7d req-41289da5-10a8-4d4d-a833-ad263cd63a3d service nova] Creating event network-vif-deleted:ec05fa9f-369d-453e-9947-0e2f98a5821f for instance 306c1542-d247-4dee-84ff-b93cf2e010c7 on hv-cinder-85061 Oct 10 12:05:43.229537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-3a97691a-8ad5-4c9b-a5fb-6d8f4b19fd7d req-41289da5-10a8-4d4d-a833-ad263cd63a3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039548 Oct 10 12:05:43.230731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 419/845] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:43.406162 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:43.419897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6844506d-448f-41c0-bf11-bdb0d910c124 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1319 microversion: 2.1 time: 0.542535 Oct 10 12:05:43.445032 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 427/846] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:42 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:05:44.033692 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:44.035694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:44.043043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:44.043908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:44.044500 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:44.045458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:44.046202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:44.046779 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:44.216713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:44.220358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:44.232241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:44.233097 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:44.233759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:44.234565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:44.236981 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:44.237512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:44.288795 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:44.290396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:44.291095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:44.291947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lazy-loading 'fault' on Instance uuid 306c1542-d247-4dee-84ff-b93cf2e010c7 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:05:44.359325 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:44.369395 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:44.371615 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:44.373213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-49b8f1c7-d89f-4d90-88d8-92f417cecbea tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.344034 Oct 10 12:05:44.374514 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 420/847] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:44 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:44.397750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7735444ca8431ea7906070374dbe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3e893bfb574016a6e5e020f96490c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:44.406333 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf59fcbf-941c-40fa-8b7e-d1c6ba5f6aac tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 200 len: 1330 microversion: 2.1 time: 0.196226 Oct 10 12:05:44.407103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 428/848] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:44 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 1330 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:05:44.446188 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:44.446978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:44.454213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:44.454857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:44.455420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:44.456239 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:44.456837 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:44.457385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:44.623299 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:44.641209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cf606a3f-ab3b-4be8-a922-58cf451906f9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1508 microversion: 2.1 time: 0.198856 Oct 10 12:05:44.654957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 421/849] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:44 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:45.400916 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:45.402193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:45.411209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.411959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.412642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.413598 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.415073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.415778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.436075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:45.436720 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:45.446269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.446767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.447501 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.448462 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.449113 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.449546 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.463874 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 HTTP/1.1 Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:45.465808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:45.467467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '306c1542-d247-4dee-84ff-b93cf2e010c7'} Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:45.468383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:45.469855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.472441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:45.473470 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-23a21af7-ce13-41f9-8cfe-c4f966058bfa tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 404 len: 111 microversion: 2.1 time: 0.041273 Oct 10 12:05:45.474508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 422/850] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:45 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:45.483856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8603daeb-21ff-45c0-a653-b722d088c795 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '.version_select at 0x7f862060a790>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:45.512495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8603daeb-21ff-45c0-a653-b722d088c795 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200621902" status: 202 len: 0 microversion: 2.1 time: 0.032581 Oct 10 12:05:45.514513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 423/851] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Oct 10 12:05:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200621902 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:05:45.630479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:45.638946 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:45.640689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:45.644044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c7c942aa-bfa9-4242-b327-b20eb6b6bb70 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.246436 Oct 10 12:05:45.644044 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 429/852] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:45 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:45.820599 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:45.822086 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:45.828834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.829532 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.829979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.830735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.831228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.831861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.848118 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] HTTP exception thrown: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Request method failure captured: Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 HTTP/1.1 Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkYggKzXXAk8s2ortDGbjFjn7f7pZtctMXoY0WgpVBrTJqyAeqZpnoDw1gfjoa_kOXc-q4b02IVoPkXLWCvgq-WkA7hOjIOQk9rOtQGmRxhy-cIs5Ao-0HRJ3w0TF6nckzrct5J7s1H2RUTfEvtVbgDazDC4HeiNVOqn7dfj-qh3q0 Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:45.849864 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79aee39298624f99b33b9808fe5030f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}] Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 0c0f1d116c004694b33b19d988ac4959 Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.851537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '6684b0b5-2c8b-4650-9955-769f646d7173'} Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:45.852430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.853627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.856191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Returning 404 to user: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:45.857365 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b704a9de-768c-4e84-94aa-1256503cca12 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 404 len: 111 microversion: 2.1 time: 0.041132 Oct 10 12:05:45.857956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 424/853] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:45 2022] DELETE /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:45.867944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:45.869023 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 6684b0b5-2c8b-4650-9955-769f646d7173] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:45.876375 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.877471 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.878191 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.879949 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:45.880769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:45.881441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:45.900462 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] HTTP exception thrown: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Request method failure captured: Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 HTTP/1.1 Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkYggKzXXAk8s2ortDGbjFjn7f7pZtctMXoY0WgpVBrTJqyAeqZpnoDw1gfjoa_kOXc-q4b02IVoPkXLWCvgq-WkA7hOjIOQk9rOtQGmRxhy-cIs5Ao-0HRJ3w0TF6nckzrct5J7s1H2RUTfEvtVbgDazDC4HeiNVOqn7dfj-qh3q0 Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:05:45.902422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79aee39298624f99b33b9808fe5030f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}] Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 0c0f1d116c004694b33b19d988ac4959 Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.903829 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '6684b0b5-2c8b-4650-9955-769f646d7173'} Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:45.904611 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. Oct 10 12:05:45.905831 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:45.909165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Returning 404 to user: Instance 6684b0b5-2c8b-4650-9955-769f646d7173 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:45.910150 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0328eed3-5d79-4872-a9ab-fbca7371fda3 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173" status: 404 len: 111 microversion: 2.1 time: 0.047474 Oct 10 12:05:45.914295 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 430/854] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:45 2022] GET /compute/v2.1/servers/6684b0b5-2c8b-4650-9955-769f646d7173 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:46.668399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:46.669646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:46.676946 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:46.677446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:46.677893 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:46.678645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:46.679138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:46.679791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:46.835296 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:46.845653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:46.847584 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:46.848847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f0eb6b70-b18f-4a82-bcd8-cc21d6682a35 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.184598 Oct 10 12:05:46.849557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 425/855] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:46 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:47.122060 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:47.126938 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:47.132556 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.133592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.134033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.135094 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.135560 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.136001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.151149 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] HTTP exception thrown: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Request method failure captured: Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 HTTP/1.1 Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkYggKzXXAk8s2ortDGbjFjn7f7pZtctMXoY0WgpVBrTJqyAeqZpnoDw1gfjoa_kOXc-q4b02IVoPkXLWCvgq-WkA7hOjIOQk9rOtQGmRxhy-cIs5Ao-0HRJ3w0TF6nckzrct5J7s1H2RUTfEvtVbgDazDC4HeiNVOqn7dfj-qh3q0 Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:05:47.152706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79aee39298624f99b33b9808fe5030f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}] Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 0c0f1d116c004694b33b19d988ac4959 Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.154075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '1f2361c0-e286-45a7-a0d6-0a62221cdd27'} Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:47.154992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.156432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.158645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Returning 404 to user: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:47.158645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bb4c9eab-8b08-4428-b96e-f3d00e00b163 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 404 len: 111 microversion: 2.1 time: 0.037079 Oct 10 12:05:47.161643 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 431/856] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:47 2022] DELETE /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:47.166200 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:47.167866 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] [instance: 1f2361c0-e286-45a7-a0d6-0a62221cdd27] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:47.175683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.176311 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.176858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.177645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.178183 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.178688 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.198034 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] HTTP exception thrown: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Request method failure captured: Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 HTTP/1.1 Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkYggKzXXAk8s2ortDGbjFjn7f7pZtctMXoY0WgpVBrTJqyAeqZpnoDw1gfjoa_kOXc-q4b02IVoPkXLWCvgq-WkA7hOjIOQk9rOtQGmRxhy-cIs5Ao-0HRJ3w0TF6nckzrct5J7s1H2RUTfEvtVbgDazDC4HeiNVOqn7dfj-qh3q0 Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:47.199746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79aee39298624f99b33b9808fe5030f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79aee39298624f99b33b9808fe5030f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79aee39298624f99b33b9808fe5030f8"}]}] Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 79aee39298624f99b33b9808fe5030f8 Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1706107779 Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 0c0f1d116c004694b33b19d988ac4959 Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-1706107779-project Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.201179 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '1f2361c0-e286-45a7-a0d6-0a62221cdd27'} Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:47.201974 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. Oct 10 12:05:47.203373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.207899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] Returning 404 to user: Instance 1f2361c0-e286-45a7-a0d6-0a62221cdd27 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:47.207899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-256fa5ce-6580-4526-b455-3b928d495292 tempest-AttachVolumeTestJSON-1706107779 tempest-AttachVolumeTestJSON-1706107779-project] 10.222.0.52 "GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27" status: 404 len: 111 microversion: 2.1 time: 0.040835 Oct 10 12:05:47.207899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 426/857] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:47 2022] GET /compute/v2.1/servers/1f2361c0-e286-45a7-a0d6-0a62221cdd27 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:47.552208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:47.553156 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:47.560898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.561406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.561856 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.562574 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.563076 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.563510 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.587965 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 HTTP/1.1 Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:05:47.590240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.591803 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '306c1542-d247-4dee-84ff-b93cf2e010c7'} Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:47.592596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.593812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.598319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:47.599833 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-38c6fdc1-764a-4e4c-98ca-55fa17424aa1 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 404 len: 111 microversion: 2.1 time: 0.054322 Oct 10 12:05:47.604670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 432/858] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:47 2022] DELETE /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:47.610628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:47.611281 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 306c1542-d247-4dee-84ff-b93cf2e010c7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:47.626735 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.628243 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.628938 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.630208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.631197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.631840 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.649642 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 HTTP/1.1 Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:47.654209 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.655670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '306c1542-d247-4dee-84ff-b93cf2e010c7'} Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:47.656513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. Oct 10 12:05:47.657815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:47.659835 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 306c1542-d247-4dee-84ff-b93cf2e010c7 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:47.660832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c7259fe-6136-47b4-9fae-ca446e74cabc tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7" status: 404 len: 111 microversion: 2.1 time: 0.054187 Oct 10 12:05:47.664929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 427/859] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:47 2022] GET /compute/v2.1/servers/306c1542-d247-4dee-84ff-b93cf2e010c7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:47.881517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:47.881517 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:47.900642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.901623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.902416 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.903749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:47.905037 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:47.906129 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:47.937649 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:48.190299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:48.199107 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:48.200839 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:48.202242 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0d97b0d5-a666-4547-8a76-b79bdbf413e6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.325999 Oct 10 12:05:48.203356 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 433/860] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:47 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:05:48.864298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:48.865496 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:48.873068 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:48.873555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:48.873996 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:48.874705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:48.875219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:48.875647 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:48.895259 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d HTTP/1.1 Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:48.898244 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.900287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '100c216f-5533-4bf3-af33-bb5c6a45017d'} Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:48.901290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.902868 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.907683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:48.907683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6e88a25a-f1ee-4189-9b90-bd04cec9e0f8 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 404 len: 111 microversion: 2.1 time: 0.038141 Oct 10 12:05:48.907683 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 428/861] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:48 2022] DELETE /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:48.914703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:48.914703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 100c216f-5533-4bf3-af33-bb5c6a45017d] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:48.921680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:48.922221 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:48.922734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:48.923474 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:48.924394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:48.924841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:48.940135 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d HTTP/1.1 Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:05:48.943306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.944977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '100c216f-5533-4bf3-af33-bb5c6a45017d'} Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:48.946588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. Oct 10 12:05:48.947867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.949006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 100c216f-5533-4bf3-af33-bb5c6a45017d could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:48.949006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c58befb2-c0d1-4b9f-aadf-630e6c7b9513 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d" status: 404 len: 111 microversion: 2.1 time: 0.041047 Oct 10 12:05:48.949006 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 434/862] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:48 2022] GET /compute/v2.1/servers/100c216f-5533-4bf3-af33-bb5c6a45017d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:48.954015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:48.954510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:48.960477 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:48.960960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:48.961441 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:48.962131 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:48.962645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:48.963280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:48.982699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef HTTP/1.1 Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:48.984716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:48.986238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '0a6a752b-46c1-419a-a67f-b438ec73dfef'} Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:48.987106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:48.988389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:48.989907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:48.989907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3eef8f0f-5077-4a6b-a042-7d2a9b65260c tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 404 len: 111 microversion: 2.1 time: 0.035878 Oct 10 12:05:48.989907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 429/863] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:48 2022] DELETE /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:48.999350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:49.000203 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0a6a752b-46c1-419a-a67f-b438ec73dfef] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:49.006520 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:49.007261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:49.007938 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:49.008882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:49.009521 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:49.010106 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:49.025487 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef HTTP/1.1 Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:05:49.027299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:49.028940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '0a6a752b-46c1-419a-a67f-b438ec73dfef'} Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:49.029851 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. Oct 10 12:05:49.031354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:49.033468 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 0a6a752b-46c1-419a-a67f-b438ec73dfef could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:49.034605 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b94f2411-1fbf-44b1-bc10-c89cd0b686bf tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef" status: 404 len: 111 microversion: 2.1 time: 0.039148 Oct 10 12:05:49.038629 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 435/864] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:48 2022] GET /compute/v2.1/servers/0a6a752b-46c1-419a-a67f-b438ec73dfef => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:49.231253 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:49.232224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:49.239137 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:49.239876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:49.240467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:49.241338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:49.241947 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:49.243155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:49.461166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:49.476076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:49.478472 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:49.480383 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9096f580-c2fd-4e76-acf2-b51d85c86dcf tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.253312 Oct 10 12:05:49.498098 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 430/865] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:49 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:50.253982 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:50.254561 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:50.261405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:50.280182 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:50.281033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:50.281536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:50.282467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:50.283072 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:50.283506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:50.301784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b HTTP/1.1 Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:05:50.304233 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.306009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '0ddfe581-92c6-4065-9fff-7ebe3462658b'} Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:50.306970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.308456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.311195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:50.312631 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ccbc3d47-481a-43fd-9e61-c05b558af367 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 404 len: 111 microversion: 2.1 time: 0.062546 Oct 10 12:05:50.313784 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 436/866] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:50 2022] DELETE /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:05:50.321491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:50.322673 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] [instance: 0ddfe581-92c6-4065-9fff-7ebe3462658b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:50.332635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:50.335378 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:50.336564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:50.338000 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:50.340418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:50.343953 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:50.349084 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:50.378080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] HTTP exception thrown: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Request method failure captured: Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b HTTP/1.1 Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkS8drIGV5mayw1j-hMx1lSYfJSfQp6_2Za2j_Dsw0GdEE1qT-3lW6UIZVRC9EMg4ERRYb45JaOECet-IegvNkqBG_uN1FsiBuxihLy0S_qJWeActNO94rfTub3ue053v2ssQh4t3UPh0EtMQ20ZiaSudzIMPFQMCMSsQRIeKq4rjk Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:05:50.384149 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de3e893bfb574016a6e5e020f96490c5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de3e893bfb574016a6e5e020f96490c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de3e893bfb574016a6e5e020f96490c5"}]}] Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: de3e893bfb574016a6e5e020f96490c5 Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1830372360 Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 2f7735444ca8431ea7906070374dbe67 Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-1830372360-project Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.386020 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '0ddfe581-92c6-4065-9fff-7ebe3462658b'} Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:50.387488 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. Oct 10 12:05:50.390065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:05:50.399889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] Returning 404 to user: Instance 0ddfe581-92c6-4065-9fff-7ebe3462658b could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:50.399889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-246cf80a-ca50-4a7c-b20b-6174c9f67d08 tempest-AttachVolumeNegativeTest-1830372360 tempest-AttachVolumeNegativeTest-1830372360-project] 10.222.0.52 "GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b" status: 404 len: 111 microversion: 2.1 time: 0.068124 Oct 10 12:05:50.399889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 431/867] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:50 2022] GET /compute/v2.1/servers/0ddfe581-92c6-4065-9fff-7ebe3462658b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:50.514667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:50.515307 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:50.548165 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:50.549157 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:50.552782 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:50.553680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:50.554299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:50.554944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:50.839348 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:50.848140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:50.849580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:50.850745 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-20e30d10-b8fa-4366-80be-b785fc4c3d9b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.340415 Oct 10 12:05:50.875350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 437/868] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:50 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:51.886579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:51.887948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:51.898151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:51.905695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:51.906968 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:51.908386 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:51.909375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:51.912196 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:52.643378 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:52.660295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:52.668657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:52.670345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-69922be7-9904-410e-b091-54f490a9395a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.795783 Oct 10 12:05:52.671513 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 432/869] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:51 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:53.700743 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:53.701361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:53.722205 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:53.727326 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:53.729542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:53.730260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:53.737687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:53.739320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:54.130603 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:54.150985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:54.152832 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:54.158049 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dadca70b-b085-48ff-9b8f-26d355352f05 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1740 microversion: 2.20 time: 0.459023 Oct 10 12:05:54.159659 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 438/870] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:53 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1740 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:55.191407 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:55.192768 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:55.206100 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:55.206598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:55.221598 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:55.222688 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:55.224657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:55.225306 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:55.556728 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:55.560336 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:55.566463 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:55.568282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c6130396-6bcb-403c-ba87-5d9d23ad1c36 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1722 microversion: 2.20 time: 0.382735 Oct 10 12:05:55.572049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 433/871] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:55 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:56.601304 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:56.602526 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:56.610697 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:56.611240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:56.611678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:56.612366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:56.613013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:56.613451 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:56.923282 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:56.932481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:56.934040 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:56.935469 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b1193d48-23fb-4cb3-b420-14821344c550 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1722 microversion: 2.20 time: 0.339842 Oct 10 12:05:56.951228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 439/872] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:56 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:57.960606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:57.961726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:57.968258 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:57.968755 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:57.969174 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:57.969869 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:57.970322 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:57.970745 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:58.143345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:58.150185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:58.151681 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:58.152859 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2cd6332c-d80d-4589-9ffd-2af49f1d00a0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1722 microversion: 2.20 time: 0.196527 Oct 10 12:05:58.167331 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 434/873] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:57 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:58.416231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-c424f979-afa9-4a44-8150-0f9548bc12df req-e33264d0-393b-4a25-a1f7-888fcda6da92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e69a02d-e65e-499c-b917-0848603db0b7", "name": "network-vif-unplugged", "status": "completed", "tag": "78c57fac-0497-4b6c-9eae-773ed6db62fe"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:58.431707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c424f979-afa9-4a44-8150-0f9548bc12df req-e33264d0-393b-4a25-a1f7-888fcda6da92 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:58.432703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c424f979-afa9-4a44-8150-0f9548bc12df req-e33264d0-393b-4a25-a1f7-888fcda6da92 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:58.434249 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c424f979-afa9-4a44-8150-0f9548bc12df req-e33264d0-393b-4a25-a1f7-888fcda6da92 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:58.450817 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-c424f979-afa9-4a44-8150-0f9548bc12df req-e33264d0-393b-4a25-a1f7-888fcda6da92 service nova] Creating event network-vif-unplugged:78c57fac-0497-4b6c-9eae-773ed6db62fe for instance 1e69a02d-e65e-499c-b917-0848603db0b7 on hv-cinder-85061 Oct 10 12:05:58.457699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-c424f979-afa9-4a44-8150-0f9548bc12df req-e33264d0-393b-4a25-a1f7-888fcda6da92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044703 Oct 10 12:05:58.458819 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 440/874] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:59.182399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:59.183627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:59.190420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:59.190940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:59.191578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:59.192692 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:59.193313 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:59.193909 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:59.339379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:59.349705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:59.352028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:59.353195 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-62f2479b-2bf2-4aa7-99c3-2a32d1804a59 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1665 microversion: 2.20 time: 0.177905 Oct 10 12:05:59.353754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 435/875] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:05:59 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:59.379707 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b800040-6ef3-4f8a-a661-f7d784a5dc7c"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:59.382105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:59.388560 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:59.389022 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:59.389520 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:59.390229 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:59.390663 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:59.391118 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:59.708161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b755ae95-d67c-471e-9e4b-1612c9c0e27a tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333045 Oct 10 12:05:59.709511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 441/876] 10.222.0.52 () {62 vars in 1364 bytes} [Mon Oct 10 12:05:59 2022] POST /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:05:59.860585 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:59.861090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:59.868073 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:59.868250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:59.868662 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:59.869554 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:59.870015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:59.870449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:00.204855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-21b651d2-2599-4955-af17-c9d9182dc762 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-volume_attachments/9b800040-6ef3-4f8a-a661-f7d784a5dc7c" status: 202 len: 0 microversion: 2.20 time: 0.348115 Oct 10 12:06:00.205727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 436/877] 10.222.0.52 () {60 vars in 1457 bytes} [Mon Oct 10 12:05:59 2022] DELETE /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-volume_attachments/9b800040-6ef3-4f8a-a661-f7d784a5dc7c => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:06:00.276283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:06:00.276890 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:00.283367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:00.283862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:00.284518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:00.285483 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:00.285948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:00.286382 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:00.318581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120662) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 12:06:00.400473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e166a990-2f48-4b20-8102-2e61d9ee3dd9 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "POST /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/action" status: 202 len: 0 microversion: 2.20 time: 0.129031 Oct 10 12:06:00.401202 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 442/878] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Oct 10 12:06:00 2022] POST /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:06:00.413190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:00.413831 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:00.421387 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:00.422097 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:00.422690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:00.423859 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:00.424492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:00.425071 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:00.653776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:00.663009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:00.665892 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:00.667738 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a3fc775d-1d56-43d4-84da-85e83bd2877b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1673 microversion: 2.20 time: 0.258693 Oct 10 12:06:00.668422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 437/879] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:00 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:01.697362 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:01.698123 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:01.706012 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:01.706929 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:01.707483 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:01.708485 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:01.709013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:01.709454 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:01.893702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:01.907544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:01.908860 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:01.910321 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e128c772-053f-4af8-9893-c1ca27c77935 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.217885 Oct 10 12:06:01.910914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 443/880] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:01 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:02.465594 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "329cadc7-dc3c-4fd4-9392-577bb6ab7e9e", "device": "/dev/sdb"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:06:02.468982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:02.477033 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:02.477832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:02.478478 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:02.479425 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:02.480537 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:02.481202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:02.928859 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6001a009-693a-4b5c-bc60-fdc285421de9 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "POST /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468362 Oct 10 12:06:02.929948 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 438/881] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:06:02 2022] POST /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:06:02.936994 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:02.937811 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:02.958010 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:02.958647 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:02.959309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:02.962405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:02.965231 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:02.967008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:03.135056 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:03.145091 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:03.146752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:03.147955 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0bfbd214-fb73-41ae-908a-da268e2368d6 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.215558 Oct 10 12:06:03.149563 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 444/882] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:02 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:06:04.175795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:04.177139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:04.184133 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:04.184802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:04.185416 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:04.186280 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:04.187144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:04.187729 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:04.369731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:04.380453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:04.383382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:04.385080 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d163a44f-f510-4aa7-91fa-80fe6064ff62 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.213970 Oct 10 12:06:04.386043 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 439/883] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:04 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:05.411124 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:05.411748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:05.419889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:05.420403 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:05.420845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:05.421591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:05.422083 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:05.422518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:05.564232 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:05.573198 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:05.574877 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:05.576259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4f500bc0-a097-4273-8254-2e43ffd79e0d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.169089 Oct 10 12:06:05.576974 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 445/884] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:05 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:06.603422 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:06.604040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:06.610593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:06.611120 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:06.611557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:06.612253 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:06.612704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:06.613122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:06.752165 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:06.761038 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:06.763788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:06.765385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7d2feefe-2b91-4210-a71c-6d8671b4ae79 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.166205 Oct 10 12:06:06.765954 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 440/885] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:06 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:07.790442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:07.792103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:07.800540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:07.801113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:07.801671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:07.802469 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:07.803034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:07.803550 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:07.943438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:07.952315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:07.953767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:07.954962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-46e5b49b-ba1d-4bac-928b-54487bf2909e tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.168494 Oct 10 12:06:07.955699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 446/886] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:07 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:08.980263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:08.980867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:08.984682 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:08.988576 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:08.989063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:08.989680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:08.990389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:08.990844 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:08.991297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:09.129466 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:09.139217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:09.140994 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:09.142182 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4849f1ec-a6c2-401c-9994-faed98cefc22 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.165874 Oct 10 12:06:09.145812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 441/887] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:08 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:10.170193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:10.170874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:10.177766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:10.178258 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:10.178697 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:10.179436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:10.180069 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:10.180580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:10.361601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:10.371333 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:10.373293 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:10.374675 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-989ae7f5-7f08-4b0e-971f-bd1fdab66bf2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.208303 Oct 10 12:06:10.375734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 447/888] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:10 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:11.415934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:11.418253 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:11.429511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:11.430375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:11.430375 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:11.431003 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:11.431450 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:11.431877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:11.633539 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:11.644445 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:11.646492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:11.648040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc00f1df-6f44-4072-85e1-840a38779a04 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.236877 Oct 10 12:06:11.649550 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 442/889] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:11 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:12.676974 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:12.677660 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:12.687489 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:12.688048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:12.688717 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:12.689591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:12.690046 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:12.690596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:12.838548 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:12.853207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:12.854664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:12.855953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-baa688b0-1989-4d96-bbdb-1c4ee80cf20b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.185038 Oct 10 12:06:12.856514 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 448/890] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:12 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:13.881630 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:13.882446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:13.889871 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:13.890353 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:13.890785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:13.891522 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:13.891975 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:13.892424 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:14.076207 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:14.086595 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:14.088804 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:14.090065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8f27986d-4257-48de-a1de-c4f8d342007b tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.212386 Oct 10 12:06:14.090740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 443/891] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:13 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:15.119114 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:15.119776 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:15.128351 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:15.129067 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:15.130130 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:15.131459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:15.132652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:15.133866 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:15.141361 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:15.284095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:15.297292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:15.299054 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:15.300209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5b4f97ee-057e-4984-ac3c-179c6610f275 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.187407 Oct 10 12:06:15.300754 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 449/892] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:15 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:06:16.331751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:16.332925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:16.343139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:16.344136 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:16.344726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:16.346312 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:16.347072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:16.347747 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:16.538815 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:16.542832 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:16.551542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-e2d50921-917c-4289-8115-04beea4ebe2e req-f55b7eb1-7977-41a3-a7bf-fdf2170db208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e69a02d-e65e-499c-b917-0848603db0b7", "name": "network-vif-plugged", "status": "completed", "tag": "78c57fac-0497-4b6c-9eae-773ed6db62fe"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:06:16.552109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:16.557028 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:16.559270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc86a220-7d69-441d-bf41-0575c4989bf0 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.232916 Oct 10 12:06:16.563189 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 444/893] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:16 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:16.568600 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e2d50921-917c-4289-8115-04beea4ebe2e req-f55b7eb1-7977-41a3-a7bf-fdf2170db208 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:16.569367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e2d50921-917c-4289-8115-04beea4ebe2e req-f55b7eb1-7977-41a3-a7bf-fdf2170db208 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:16.570310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e2d50921-917c-4289-8115-04beea4ebe2e req-f55b7eb1-7977-41a3-a7bf-fdf2170db208 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:16.585974 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-e2d50921-917c-4289-8115-04beea4ebe2e req-f55b7eb1-7977-41a3-a7bf-fdf2170db208 service nova] Creating event network-vif-plugged:78c57fac-0497-4b6c-9eae-773ed6db62fe for instance 1e69a02d-e65e-499c-b917-0848603db0b7 on hv-cinder-85061 Oct 10 12:06:16.592088 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-e2d50921-917c-4289-8115-04beea4ebe2e req-f55b7eb1-7977-41a3-a7bf-fdf2170db208 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045142 Oct 10 12:06:16.593533 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 450/894] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:06:17.590169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:17.590784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:17.598075 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:17.598564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:17.599033 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:17.599733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:17.600191 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:17.600622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:17.806062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:17.814112 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:17.815590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:17.816747 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ca0934ce-9128-4d49-aa8a-6bc6e15c3a06 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.230935 Oct 10 12:06:17.817315 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 445/895] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:17 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:18.843911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:18.844645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:18.850950 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:18.851480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:18.851922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:18.853290 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:18.853748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:18.854209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:18.982029 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:18.990027 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:18.991513 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:18.992681 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c71312e0-7980-4b38-a828-0a02b37538cd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.153736 Oct 10 12:06:18.993230 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 451/896] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:18 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:20.017949 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:20.018502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:20.025072 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:20.025612 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:20.026126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:20.026746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:20.027235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:20.027657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:20.155409 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:20.163483 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:20.165428 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:20.166572 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0dc8edc3-1d8a-4c9d-b1e2-b747ea1c0317 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.152703 Oct 10 12:06:20.167145 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 446/897] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:20 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:21.191854 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:21.192472 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:21.195003 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:21.200685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:21.201171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:21.201701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:21.202296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:21.202753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:21.203209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:21.327975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:21.335967 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:21.337406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:21.338582 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-33a6d136-8b81-40f6-aa58-249de3420ce5 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1731 microversion: 2.20 time: 0.150668 Oct 10 12:06:21.339176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 452/898] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:21 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:22.364250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:22.364867 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:22.372278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:22.372700 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:22.373135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:22.373829 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:22.374287 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:22.374715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:22.503327 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:22.513737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:22.515603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:22.517076 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0ceb4b23-18da-497a-a3e0-86da6fd44b12 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1718 microversion: 2.20 time: 0.156733 Oct 10 12:06:22.517883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 447/899] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:06:22 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:51.025347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:51.026476 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:51.030579 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:51.031468 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=19 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:51.036659 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:51.038100 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:51.040497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:51.041913 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:51.042553 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:51.046170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:51.145379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lazy-loading 'services' on Instance uuid 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:06:51.261947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-30013b5d-29b4-400a-a75c-4533dae5494a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb/os-volume_attachments/329cadc7-dc3c-4fd4-9392-577bb6ab7e9e" status: 202 len: 0 microversion: 2.1 time: 0.243345 Oct 10 12:06:51.264134 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 453/900] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:06:51 2022] DELETE /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb/os-volume_attachments/329cadc7-dc3c-4fd4-9392-577bb6ab7e9e => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:06:52.445421 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:52.447804 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:52.454250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=13 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:52.455177 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=19 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:52.456706 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:52.457197 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:52.457638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:52.458348 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:52.458814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:52.459290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:52.527211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:06:52.703059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-314e3abb-8514-4d8f-b5e1-e869e82073d2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 204 len: 0 microversion: 2.1 time: 0.263230 Oct 10 12:06:52.703935 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 448/901] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:06:52 2022] DELETE /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:06:52.716423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:52.717537 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:52.730372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:52.730872 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:52.731336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:52.732046 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:52.732508 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:52.732927 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:52.927220 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:52.939296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a0f88bd3-36b4-45d1-8ed7-d13cdf19269a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1514 microversion: 2.1 time: 0.230599 Oct 10 12:06:52.939896 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 454/902] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:06:52 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:06:53.967703 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:53.968707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:53.978345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:53.979635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:53.980272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:53.983784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:53.984217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:53.985843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:54.210798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:54.222014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-541fd4dd-648e-4a43-9e1c-ebd3fe7a79f2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1514 microversion: 2.1 time: 0.261209 Oct 10 12:06:54.223101 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 449/903] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:06:53 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:06:55.246664 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:55.247334 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:55.256310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:55.257350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:55.257970 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:55.259684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:55.260963 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:55.261806 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:55.507543 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:55.522542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-49658d55-edbf-41a0-8336-2e4405ff1e26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1514 microversion: 2.1 time: 0.279778 Oct 10 12:06:55.523427 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 455/904] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:06:55 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:06:56.548359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:56.549123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:56.562378 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:56.562924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:56.563364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:56.575495 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:56.575989 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:56.576432 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:56.881340 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:56.890036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f1e5f26e-71a5-42ce-ae61-0e0154751b2a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1514 microversion: 2.1 time: 0.347413 Oct 10 12:06:56.890940 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 450/905] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:06:56 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1514 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:06:57.213048 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-892e512b-41eb-4a13-a651-9ea7428b128f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Action: 'create', calling method: .version_select at 0x7f86205a7700>, body: {"keypair": {"name": "tempest-TestShelveInstance-305845405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITxnLYf4ueSeeMy7aAettJZAcKgGjNWHcKws9IVBs5W8hoRoE3A6stQArQjJY9DpVXKR7dLqlyRBLKR0dn3F6nSJvPl6bXQBnA1NB2wNOx++ZyBZFRhVo7No51adQuNWQ=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:06:57.236500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-892e512b-41eb-4a13-a651-9ea7428b128f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Getting quotas for project 52575749f6f6409b947c28bb16649eb7. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:06:57.244841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-892e512b-41eb-4a13-a651-9ea7428b128f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Getting quotas for user fe67ba70aef540e98dc56fe609077f93 and project 52575749f6f6409b947c28bb16649eb7. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:06:57.277396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-892e512b-41eb-4a13-a651-9ea7428b128f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.256635 Oct 10 12:06:57.278969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 456/906] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Oct 10 12:06:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:06:57.515992 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-77ddb0d0-7f4c-47a8-9c1f-8682d2e35953 req-80f09e33-ce94-46e0-9de2-e818f4285bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb", "name": "network-vif-deleted", "tag": "a90332e5-ecc6-46bf-b01f-c3ef0160a937"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:06:57.530465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77ddb0d0-7f4c-47a8-9c1f-8682d2e35953 req-80f09e33-ce94-46e0-9de2-e818f4285bc0 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:57.531088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77ddb0d0-7f4c-47a8-9c1f-8682d2e35953 req-80f09e33-ce94-46e0-9de2-e818f4285bc0 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:57.531529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-77ddb0d0-7f4c-47a8-9c1f-8682d2e35953 req-80f09e33-ce94-46e0-9de2-e818f4285bc0 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:57.579070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-77ddb0d0-7f4c-47a8-9c1f-8682d2e35953 req-80f09e33-ce94-46e0-9de2-e818f4285bc0 service nova] Creating event network-vif-deleted:a90332e5-ecc6-46bf-b01f-c3ef0160a937 for instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb on hv-cinder-85061 Oct 10 12:06:57.585849 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-77ddb0d0-7f4c-47a8-9c1f-8682d2e35953 req-80f09e33-ce94-46e0-9de2-e818f4285bc0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073605 Oct 10 12:06:57.595190 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 451/907] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:06:57.914450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:57.915280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:57.926596 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:57.927121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:57.927947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:57.929254 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:57.930619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:57.931257 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:57.982570 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:57.983478 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:57.984215 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:57.985063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lazy-loading 'fault' on Instance uuid 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:06:58.068154 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:06:58.080336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-57869735-6aea-435e-a94a-9e1eea1aaeb2 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 200 len: 1309 microversion: 2.1 time: 0.170392 Oct 10 12:06:58.080998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 457/908] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:06:57 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:06:59.113137 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:06:59.113854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:06:59.120256 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:59.120750 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:59.121507 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:59.121915 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:59.122371 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:59.122994 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:59.147800 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] HTTP exception thrown: Instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb could not be found. Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Request method failure captured: Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb HTTP/1.1 Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAqI_eac4zGTmDVT0YhOudAkTBHtq9ptzL-Gbh26E9hW5RQUMy2D-0clPMsgLNEDL_bkG5mSlb5Wxf-AHtyMoWXSXTbJYTQetyABzW_0xvNfJiUuWw7z7ic9frLLVVIMvJ9lWifuPR5dEMDm57w394O9gJydXAi5j2LyRtEoMTomGA4 Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0223b57233664d0785c96ec98335e307 Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1021339458 Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:06:59.150743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0223b57233664d0785c96ec98335e307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0223b57233664d0785c96ec98335e307", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0223b57233664d0785c96ec98335e307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0223b57233664d0785c96ec98335e307"}]}] Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotTestJSON-1021339458 Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0223b57233664d0785c96ec98335e307 Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1021339458 Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotTestJSON-1021339458-project Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 0243f437de8b439984375303ff49f9e3 Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotTestJSON-1021339458-project Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb could not be found. Oct 10 12:06:59.152650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb'} Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb could not be found. Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:06:59.153650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb could not be found. Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb could not be found. Oct 10 12:06:59.155288 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:06:59.156737 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Returning 404 to user: Instance 7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:06:59.157532 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-153d8b61-c135-4520-92ba-d33efa9d1eb0 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb" status: 404 len: 111 microversion: 2.1 time: 0.047684 Oct 10 12:06:59.157986 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 452/909] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:06:59 2022] GET /compute/v2.1/servers/7b33d3cf-a80e-4bc7-a3e3-42528c3da7fb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:04.612609 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-643637818", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-535509752", "security_groups": [{"name": "tempest-secgroup-smoke-1779695716"}], "block_device_mapping_v2": [{"uuid": "123d5f49-3826-48ce-a233-5705c0e6f1da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "099cba3b-5410-4f1b-a5a9-7c05259222ec"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:04.763705 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] validate_networks() for [('099cba3b-5410-4f1b-a5a9-7c05259222ec', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:07:05.152325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:07:05.152749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:07:05.153223 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:07:05.153691 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:07:05.154104 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:07:05.162826 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:05.163353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:05.163789 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:05.165019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:05.165480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:05.165911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:05.182947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:07:05.186816 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Getting quotas for user ce6a1b5ca7584f90bfe83b73aff1335a and project 638435e7c9ea431aa6ad3674ee6ff2ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:07:05.244477 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:07:05.246672 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='123d5f49-3826-48ce-a233-5705c0e6f1da',volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:07:05.378400 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9de124d9-d7fe-4d3d-9eee-faf689bd8ed5 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770157 Oct 10 12:07:05.379370 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 458/910] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:07:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:07:05.390578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-280d114e-9124-4c61-9c1a-c2b1e0deba85 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:05.391224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-280d114e-9124-4c61-9c1a-c2b1e0deba85 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:05.454031 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-280d114e-9124-4c61-9c1a-c2b1e0deba85 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:05.461678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-280d114e-9124-4c61-9c1a-c2b1e0deba85 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1093 microversion: 2.1 time: 0.074582 Oct 10 12:07:05.462241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 453/911] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:05 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:06.485280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:06.485892 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:06.492835 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:06.493318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:06.493753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:06.494442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:06.494922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:06.495365 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:06.555742 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:06.563431 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1ac698b8-127c-44b7-98b7-81c6b247db06 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1143 microversion: 2.1 time: 0.082504 Oct 10 12:07:06.563994 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 459/912] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:06 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:07.585628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:07.586240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:07.593707 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:07.594187 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:07.594615 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:07.595328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:07.595784 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:07.596201 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:07.659929 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:07.667548 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-29051b6b-3a0e-41a7-aee1-20586fd2a5ef tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1143 microversion: 2.1 time: 0.085763 Oct 10 12:07:07.668111 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 454/913] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:07 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:08.690951 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:08.692424 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:08.699090 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:08.699581 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:08.700019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:08.700910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:08.701538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:08.701992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:08.781099 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:08.794657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-79940afe-1bb0-448d-8cfa-66c49b81a637 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1199 microversion: 2.1 time: 0.107708 Oct 10 12:07:08.795271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 460/914] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:08 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:09.818391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:09.819055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:09.826044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:09.826528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:09.826990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:09.827681 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:09.828142 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:09.828566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:09.956255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:09.963875 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b2c6a66c-ec0d-4a5f-a2eb-15c0b758f3e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1277 microversion: 2.1 time: 0.149455 Oct 10 12:07:09.964474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 455/915] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:09 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:10.986693 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:10.987259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:10.994095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:10.994576 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:10.995035 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:10.995720 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:10.996171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:10.996591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:11.123896 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:11.131455 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b8b6fce4-6079-4af5-aa72-4dc902566457 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1277 microversion: 2.1 time: 0.148662 Oct 10 12:07:11.132015 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 461/916] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:10 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:12.153787 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:12.154396 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:12.160779 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:12.161257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:12.161691 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:12.162377 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:12.162829 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:12.163282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:12.668362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:12.677172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-abb5dbeb-1f57-440d-80df-ad0302f43e24 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1277 microversion: 2.1 time: 0.527152 Oct 10 12:07:12.677884 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 456/917] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:12 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1277 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:12.734464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:12.737407 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:12.745507 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:12.746080 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:12.746589 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:12.747434 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:12.748024 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:12.748521 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:12.779542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2343599b-d02f-49d8-ad54-2d67b0bc5c99 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049248 Oct 10 12:07:12.780352 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 462/918] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Oct 10 12:07:12 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:12.855328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:12.855963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:12.861947 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:12.862532 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:12.863201 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:12.864016 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:12.864580 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:12.865144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:12.892654 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:07:12.986397 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cbdd0a85-d8a0-4b08-9a3b-2792a3d226db tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 204 len: 0 microversion: 2.20 time: 0.134693 Oct 10 12:07:12.987324 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 457/919] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Oct 10 12:07:12 2022] DELETE /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 12:07:12.997612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:12.998457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:13.005296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:13.005778 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:13.006209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:13.007016 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:13.007475 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:13.007893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:13.259556 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:13.269175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:13.270626 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:13.271916 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a2df5085-e599-4079-ad34-4355a79e2f31 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.279503 Oct 10 12:07:13.282254 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 463/920] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:07:12 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:07:13.507682 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-75f76dd4-a63c-416c-82a7-3ef3d1cd7637 req-f1c06190-a94a-453c-91e2-681cda59062d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fe1e01-2c4c-4efa-baa0-09560129a37f", "tag": "4ec5973c-48f3-4f05-b8e3-cfca1d4deb74"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:13.516372 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1050111494", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "networks": [{"uuid": "b924ba9b-07bb-4c95-8c7c-b804d947af19"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:13.521192 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-75f76dd4-a63c-416c-82a7-3ef3d1cd7637 req-f1c06190-a94a-453c-91e2-681cda59062d service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:13.522263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-75f76dd4-a63c-416c-82a7-3ef3d1cd7637 req-f1c06190-a94a-453c-91e2-681cda59062d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:13.522263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-75f76dd4-a63c-416c-82a7-3ef3d1cd7637 req-f1c06190-a94a-453c-91e2-681cda59062d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:13.537746 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-75f76dd4-a63c-416c-82a7-3ef3d1cd7637 req-f1c06190-a94a-453c-91e2-681cda59062d service nova] Creating event network-changed:4ec5973c-48f3-4f05-b8e3-cfca1d4deb74 for instance d0fe1e01-2c4c-4efa-baa0-09560129a37f on hv-cinder-85061 Oct 10 12:07:13.543326 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-75f76dd4-a63c-416c-82a7-3ef3d1cd7637 req-f1c06190-a94a-453c-91e2-681cda59062d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041745 Oct 10 12:07:13.544146 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 458/921] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:13.574911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] validate_networks() for [('b924ba9b-07bb-4c95-8c7c-b804d947af19', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:07:13.707671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:13.708373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:13.714727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:13.715240 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:13.715677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:13.716497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:13.716979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:13.717405 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:13.976743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:13.985092 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4f4dd093-7138-4dc6-a66a-c17522691f73 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.286639 Oct 10 12:07:13.985655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 459/922] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:13 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:14.016933 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:07:14.017450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:07:14.017820 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:07:14.018263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:07:14.018680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:07:14.027267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:14.027750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:14.028186 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:14.028908 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:14.029362 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:14.029787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:14.046321 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Getting quotas for project 0223b57233664d0785c96ec98335e307. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:07:14.050583 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Getting quotas for user 0243f437de8b439984375303ff49f9e3 and project 0223b57233664d0785c96ec98335e307. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:07:14.062223 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:07:14.064442 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:07:14.109259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d5378a95-80d0-4cbe-8f6b-28016f0ea918 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598083 Oct 10 12:07:14.109912 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 464/923] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:07:14.121663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f4199187-f3fa-4b5e-b71a-91495a536397 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:14.122272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f4199187-f3fa-4b5e-b71a-91495a536397 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:14.175590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f4199187-f3fa-4b5e-b71a-91495a536397 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:14.182556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f4199187-f3fa-4b5e-b71a-91495a536397 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1219 microversion: 2.1 time: 0.065372 Oct 10 12:07:14.183172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 460/924] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:14 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:14.298206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:14.299151 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:14.308602 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:14.309330 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:14.310113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:14.310922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:14.311563 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:14.312273 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:14.448027 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:14.456288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:14.457741 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:14.458961 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d00e2911-fa6e-48b3-ab0a-6ba6435b22be tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.165852 Oct 10 12:07:14.459525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 465/925] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:07:14 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:07:15.009063 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:15.010175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:15.017602 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:15.018268 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:15.018872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:15.019767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:15.020409 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:15.021000 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:15.206736 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:15.208177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:15.220980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:15.222628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:15.223432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:15.224432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:15.225750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:15.226501 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:15.282050 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:15.294148 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bea3f73b-ec1e-40ca-aa21-77d507fbfd89 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.288894 Oct 10 12:07:15.312857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 461/926] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:15 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:15.400366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:15.409537 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bb6d41cf-a828-4e3a-ac48-6c81f63a4715 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1271 microversion: 2.1 time: 0.207185 Oct 10 12:07:15.411105 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 466/927] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:15 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:15.486151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:15.487126 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:15.494354 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:15.498981 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:15.499866 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:15.501058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:15.501645 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:15.502397 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:15.670857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:15.680777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:15.683109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:15.684279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8e1a4ea8-8e51-41a1-bf48-8bf1700d49c8 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1724 microversion: 2.20 time: 0.202249 Oct 10 12:07:15.684827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 462/928] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:07:15 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:07:16.318684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:16.319621 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:16.331312 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:16.332058 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:16.333642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:16.335810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:16.344082 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-15f0def8-acb0-4c71-b2aa-0a07717b7ac7 req-7ac10f5e-5a90-4ec9-a79a-876d41f5ce2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e69a02d-e65e-499c-b917-0848603db0b7", "name": "network-vif-deleted", "tag": "78c57fac-0497-4b6c-9eae-773ed6db62fe"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:16.349454 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:16.350671 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:16.364646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-15f0def8-acb0-4c71-b2aa-0a07717b7ac7 req-7ac10f5e-5a90-4ec9-a79a-876d41f5ce2e service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:16.378644 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-15f0def8-acb0-4c71-b2aa-0a07717b7ac7 req-7ac10f5e-5a90-4ec9-a79a-876d41f5ce2e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:16.379462 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-15f0def8-acb0-4c71-b2aa-0a07717b7ac7 req-7ac10f5e-5a90-4ec9-a79a-876d41f5ce2e service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:16.424684 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-15f0def8-acb0-4c71-b2aa-0a07717b7ac7 req-7ac10f5e-5a90-4ec9-a79a-876d41f5ce2e service nova] Creating event network-vif-deleted:78c57fac-0497-4b6c-9eae-773ed6db62fe for instance 1e69a02d-e65e-499c-b917-0848603db0b7 on hv-cinder-85061 Oct 10 12:07:16.447865 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-15f0def8-acb0-4c71-b2aa-0a07717b7ac7 req-7ac10f5e-5a90-4ec9-a79a-876d41f5ce2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106902 Oct 10 12:07:16.454344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 463/929] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:07:16.461368 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:16.468871 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:16.483972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:16.487436 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:16.488109 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:16.491860 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:16.495138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:16.496695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:16.983608 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:17.001069 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3755aac1-4fc6-4819-85fa-0cdad2736449 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1277 microversion: 2.1 time: 0.541891 Oct 10 12:07:17.003102 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 464/930] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:16 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1277 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:17.018622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:17.019711 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:17.027440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:17.028339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:17.028847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:17.029927 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:17.030644 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:17.031423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:17.062286 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:17.071936 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-30ddc562-10ad-46ba-8db1-dbb25134801e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.757898 Oct 10 12:07:17.077622 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 467/931] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:16 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:17.083881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:17.084907 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:17.085345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:17.085794 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lazy-loading 'fault' on Instance uuid 1e69a02d-e65e-499c-b917-0848603db0b7 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:07:17.122960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:17.239797 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:17.251806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:17.254477 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b051e414038b470691ee3e91b952a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0156957151444f94be28a65b4b018156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:17.256934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a8381196-b939-4448-9778-ac3a5622cb8d tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 200 len: 1372 microversion: 2.20 time: 0.252414 Oct 10 12:07:17.259033 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 465/932] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:07:17 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:07:18.027670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:18.028228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:18.034617 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:18.035146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:18.035586 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:18.036283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:18.036744 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:18.037171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:18.097680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:18.098309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:18.105393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:18.105886 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:18.106523 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:18.107259 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:18.107727 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:18.108155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:18.330433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:18.338113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bc6bfb45-7482-44c8-9c39-d78a1f27e07c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1319 microversion: 2.1 time: 0.314936 Oct 10 12:07:18.338585 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 468/933] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:18 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:18.343214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:18.343818 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:18.349551 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:18.350028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:18.350500 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:18.351214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:18.351662 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:18.352081 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:18.365111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] HTTP exception thrown: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Request method failure captured: Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 HTTP/1.1 Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkKbumW7bExRvUszHULb5RaFKNQwjxyjiAWOhhQpRd29zOR54GOwm_dFXPRvgc_82bX0QDNI_fdmZklTNB2MnoNhOrzb2whrcb1LABoRNxucGupHQG3iAm1RFdNLwYQQbNnJh7qiGrfQoih-CA-AJtFM9D_1BOdIjemspTqIe4japQ Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:07:18.366764 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0156957151444f94be28a65b4b018156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0156957151444f94be28a65b4b018156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}] Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: b051e414038b470691ee3e91b952a87d Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:18.368657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '1e69a02d-e65e-499c-b917-0848603db0b7'} Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:18.370248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:18.371942 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:18.374481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Returning 404 to user: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:18.374481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-817e5b02-30e3-4999-8541-e7f0bcef42bd tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 404 len: 111 microversion: 2.20 time: 0.028631 Oct 10 12:07:18.374481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 469/934] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:07:18 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:07:18.378177 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-412edbcd-21ec-4781-b6d3-b37797493c81 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '.version_select at 0x7f86206aa430>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:18.379081 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:18.388490 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5523af1a-abf3-42ed-a43e-a2f3987f2d53 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.294447 Oct 10 12:07:18.389425 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 466/935] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:18 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:18.404958 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-412edbcd-21ec-4781-b6d3-b37797493c81 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856849859" status: 204 len: 0 microversion: 2.20 time: 0.030562 Oct 10 12:07:18.405809 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 470/936] 10.222.0.52 () {60 vars in 1262 bytes} [Mon Oct 10 12:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856849859 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 12:07:18.539529 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-9ad96739-7866-4916-92f3-280fd06d18d1 req-b2c1050f-a574-4f2f-87bd-1d0ce5410dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa66ebde-6b02-4f5d-b8a5-acc9daf624a1", "tag": "c9490bd5-97d9-47e7-aa61-0a0706797b45"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:18.556843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9ad96739-7866-4916-92f3-280fd06d18d1 req-b2c1050f-a574-4f2f-87bd-1d0ce5410dc9 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:18.557538 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9ad96739-7866-4916-92f3-280fd06d18d1 req-b2c1050f-a574-4f2f-87bd-1d0ce5410dc9 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:18.557969 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9ad96739-7866-4916-92f3-280fd06d18d1 req-b2c1050f-a574-4f2f-87bd-1d0ce5410dc9 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:18.591212 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-9ad96739-7866-4916-92f3-280fd06d18d1 req-b2c1050f-a574-4f2f-87bd-1d0ce5410dc9 service nova] Creating event network-changed:c9490bd5-97d9-47e7-aa61-0a0706797b45 for instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 on hv-cinder-85061 Oct 10 12:07:18.603903 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-9ad96739-7866-4916-92f3-280fd06d18d1 req-b2c1050f-a574-4f2f-87bd-1d0ce5410dc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069127 Oct 10 12:07:18.604509 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 467/937] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:19.362103 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:19.362816 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:19.370063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:19.370547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:19.371013 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:19.371713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:19.372175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:19.372601 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:19.413705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:19.414978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:19.422987 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:19.423468 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:19.423899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:19.424599 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:19.425049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:19.425541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:19.575763 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:19.583567 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b9223cc7-9533-412c-8e1b-3949f43711e1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1319 microversion: 2.1 time: 0.226042 Oct 10 12:07:19.584128 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 471/938] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:19 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:19.603834 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:19.611581 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c57f8ddb-7573-4f57-882a-8b782479f4dd tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.202005 Oct 10 12:07:19.612150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 468/939] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:19 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:20.194919 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:20.195426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:20.202871 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.203388 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.203827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.204526 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.204984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.205408 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.219444 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] HTTP exception thrown: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Request method failure captured: Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 HTTP/1.1 Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAkKbumW7bExRvUszHULb5RaFKNQwjxyjiAWOhhQpRd29zOR54GOwm_dFXPRvgc_82bX0QDNI_fdmZklTNB2MnoNhOrzb2whrcb1LABoRNxucGupHQG3iAm1RFdNLwYQQbNnJh7qiGrfQoih-CA-AJtFM9D_1BOdIjemspTqIe4japQ Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:07:20.221007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0156957151444f94be28a65b4b018156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0156957151444f94be28a65b4b018156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}] Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: b051e414038b470691ee3e91b952a87d Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.222727 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '1e69a02d-e65e-499c-b917-0848603db0b7'} Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:20.227386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.229227 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.230750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Returning 404 to user: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:20.230750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e2b3847d-4ea4-4d07-9ce7-09d8788f63dc tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 404 len: 111 microversion: 2.20 time: 0.031436 Oct 10 12:07:20.230750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 472/940] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Oct 10 12:07:20 2022] DELETE /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:07:20.232887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:20.233508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 1e69a02d-e65e-499c-b917-0848603db0b7] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:20.240017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.240501 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.240941 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.241639 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.242102 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.242531 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.256314 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] HTTP exception thrown: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Request method failure captured: Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 HTTP/1.1 Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkKbumW7bExRvUszHULb5RaFKNQwjxyjiAWOhhQpRd29zOR54GOwm_dFXPRvgc_82bX0QDNI_fdmZklTNB2MnoNhOrzb2whrcb1LABoRNxucGupHQG3iAm1RFdNLwYQQbNnJh7qiGrfQoih-CA-AJtFM9D_1BOdIjemspTqIe4japQ Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:07:20.257972 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0156957151444f94be28a65b4b018156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0156957151444f94be28a65b4b018156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}] Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: b051e414038b470691ee3e91b952a87d Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.260370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '1e69a02d-e65e-499c-b917-0848603db0b7'} Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:20.261295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. Oct 10 12:07:20.262795 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:20.264379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Returning 404 to user: Instance 1e69a02d-e65e-499c-b917-0848603db0b7 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:20.264379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-88f89355-8503-4daa-b2c5-ebf2b115c5e2 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7" status: 404 len: 111 microversion: 2.20 time: 0.031292 Oct 10 12:07:20.264379 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 469/941] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:07:20 2022] GET /compute/v2.1/servers/1e69a02d-e65e-499c-b917-0848603db0b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:07:20.609588 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:20.611353 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:20.620172 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.621164 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.622348 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.623492 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.624559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.625455 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.642150 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:20.645366 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:20.658359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.659184 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.660664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.661523 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:20.664221 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:20.664978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:20.666809 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:20.897369 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:20.905156 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c88b631f-d43c-4d3a-96fa-62cbc16db0fc tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1319 microversion: 2.1 time: 0.303365 Oct 10 12:07:20.905719 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 473/942] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:20 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:20.910469 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1211557819", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-305845405", "security_groups": [{"name": "tempest-secgroup-smoke-794843013"}], "networks": [{"uuid": "483a09a3-ddf6-44a4-84ed-29db31f2e66b"}], "block_device_mapping_v2": [{"uuid": "a3263ded-6a0e-40e6-8b62-fae987aa8e68", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:20.911620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:20.927343 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-23d737d2-6190-4fc9-a1f3-c9abfc0684f0 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.294687 Oct 10 12:07:20.927998 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 470/943] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:20 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:21.082259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] validate_networks() for [('483a09a3-ddf6-44a4-84ed-29db31f2e66b', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:07:21.269898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:21.406947 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:21.408413 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:21.415242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.416535 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.417158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.418017 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.418730 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.419225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.433890 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] HTTP exception thrown: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Request method failure captured: Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a HTTP/1.1 Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkKbumW7bExRvUszHULb5RaFKNQwjxyjiAWOhhQpRd29zOR54GOwm_dFXPRvgc_82bX0QDNI_fdmZklTNB2MnoNhOrzb2whrcb1LABoRNxucGupHQG3iAm1RFdNLwYQQbNnJh7qiGrfQoih-CA-AJtFM9D_1BOdIjemspTqIe4japQ Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:07:21.435491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0156957151444f94be28a65b4b018156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0156957151444f94be28a65b4b018156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}] Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: b051e414038b470691ee3e91b952a87d Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.437248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '37bc3237-f592-4db7-9f6a-294f4cea3c9a'} Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:21.439632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.442014 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.443589 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Returning 404 to user: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:21.443589 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3e82d176-4324-44cd-ae2c-98f043a9cbe3 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "DELETE /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 404 len: 111 microversion: 2.20 time: 0.037376 Oct 10 12:07:21.443589 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 471/944] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Oct 10 12:07:21 2022] DELETE /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:07:21.445509 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:21.446120 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] [instance: 37bc3237-f592-4db7-9f6a-294f4cea3c9a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:21.451960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.452448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.452919 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.453611 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.454065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.454591 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.479628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] HTTP exception thrown: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Request method failure captured: Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a HTTP/1.1 Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAkKbumW7bExRvUszHULb5RaFKNQwjxyjiAWOhhQpRd29zOR54GOwm_dFXPRvgc_82bX0QDNI_fdmZklTNB2MnoNhOrzb2whrcb1LABoRNxucGupHQG3iAm1RFdNLwYQQbNnJh7qiGrfQoih-CA-AJtFM9D_1BOdIjemspTqIe4japQ Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:07:21.482045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0156957151444f94be28a65b4b018156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0156957151444f94be28a65b4b018156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0156957151444f94be28a65b4b018156"}]}] Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0156957151444f94be28a65b4b018156 Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082446683 Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: b051e414038b470691ee3e91b952a87d Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082446683-project Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.483960 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '37bc3237-f592-4db7-9f6a-294f4cea3c9a'} Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:21.484897 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. Oct 10 12:07:21.487223 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:21.488557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] Returning 404 to user: Instance 37bc3237-f592-4db7-9f6a-294f4cea3c9a could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:21.488557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-734bca84-6792-442e-b344-e194e1c6fe09 tempest-AttachVolumeShelveTestJSON-1082446683 tempest-AttachVolumeShelveTestJSON-1082446683-project] 10.222.0.52 "GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a" status: 404 len: 111 microversion: 2.20 time: 0.041757 Oct 10 12:07:21.488557 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 472/945] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Oct 10 12:07:21 2022] GET /compute/v2.1/servers/37bc3237-f592-4db7-9f6a-294f4cea3c9a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:07:21.495912 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:07:21.496407 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:07:21.496948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:07:21.497422 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:07:21.497895 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:07:21.504457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=17 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:21.511038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.511566 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.512106 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.513079 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.513535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.513962 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.533306 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Getting quotas for project 52575749f6f6409b947c28bb16649eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:07:21.537734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Getting quotas for user fe67ba70aef540e98dc56fe609077f93 and project 52575749f6f6409b947c28bb16649eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:07:21.604073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:07:21.606161 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3263ded-6a0e-40e6-8b62-fae987aa8e68',volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:07:21.773552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6051b4c3-faeb-40ba-8039-62fe81c09399 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.866780 Oct 10 12:07:21.774376 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 474/946] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:07:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:07:21.787825 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d18826e4-d6e8-4c06-917d-e877406c4fe8 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:21.790492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d18826e4-d6e8-4c06-917d-e877406c4fe8 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:21.869879 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d18826e4-d6e8-4c06-917d-e877406c4fe8 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:21.879556 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d18826e4-d6e8-4c06-917d-e877406c4fe8 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1088 microversion: 2.1 time: 0.096611 Oct 10 12:07:21.880355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 473/947] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:21 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1088 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:21.943928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:21.944848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:21.950227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:21.951233 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:21.953573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.954320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.955112 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.956090 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.956713 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.957095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.958367 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.958857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.959321 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:21.960015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:21.960988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:21.961617 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:22.178494 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:22.193406 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a3fcc30c-51b7-4a0a-901c-0d6d085c3f81 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1319 microversion: 2.1 time: 0.267944 Oct 10 12:07:22.193997 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 475/948] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:21 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:22.201158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:22.215719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-30f580a5-32a4-40eb-927f-1a431feea1bb tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.269814 Oct 10 12:07:22.216467 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 474/949] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:21 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:22.903394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:22.904309 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:22.911508 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:22.911997 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:22.912640 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:22.913355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:22.913850 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:22.914421 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:22.979518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:22.987539 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-227c95f2-e075-433b-9995-a6f371a63f00 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1186 microversion: 2.1 time: 0.087958 Oct 10 12:07:22.988179 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 476/950] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:22 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:23.218653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:23.220089 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:23.226144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:23.227747 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:23.228265 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:23.229070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:23.230053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:23.231247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:23.231743 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:23.239667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:23.240562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:23.247317 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:23.248027 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:23.248458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:23.249360 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:23.249819 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:23.250245 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:23.503385 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:23.512304 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-40e45cf3-022e-4e98-b4a4-9c0eb516ea8c tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1319 microversion: 2.1 time: 0.298182 Oct 10 12:07:23.529394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 475/951] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:23 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:23.532871 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:23.541199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d157190d-87b7-40da-88d7-29ecbfe8643e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.306050 Oct 10 12:07:23.541999 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 477/952] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:23 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:24.012217 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:24.012912 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:24.019990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:24.020751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:24.021534 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:24.022228 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:24.022904 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:24.023370 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:24.072585 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-76baabcb-476f-4041-b24d-fcf1d2fa401f req-410ed3a6-8d0c-4972-91af-66605768ec10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa66ebde-6b02-4f5d-b8a5-acc9daf624a1", "name": "network-vif-plugged", "status": "completed", "tag": "c9490bd5-97d9-47e7-aa61-0a0706797b45"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:24.083527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-76baabcb-476f-4041-b24d-fcf1d2fa401f req-410ed3a6-8d0c-4972-91af-66605768ec10 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:24.084020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-76baabcb-476f-4041-b24d-fcf1d2fa401f req-410ed3a6-8d0c-4972-91af-66605768ec10 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:24.084633 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-76baabcb-476f-4041-b24d-fcf1d2fa401f req-410ed3a6-8d0c-4972-91af-66605768ec10 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:24.097137 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-76baabcb-476f-4041-b24d-fcf1d2fa401f req-410ed3a6-8d0c-4972-91af-66605768ec10 service nova] Creating event network-vif-plugged:c9490bd5-97d9-47e7-aa61-0a0706797b45 for instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 on hv-cinder-85061 Oct 10 12:07:24.103117 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-76baabcb-476f-4041-b24d-fcf1d2fa401f req-410ed3a6-8d0c-4972-91af-66605768ec10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034749 Oct 10 12:07:24.103937 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 478/953] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:24.123809 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:24.135065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-67f5cd00-6394-4dfe-a2b5-128c07c67ad3 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1204 microversion: 2.1 time: 0.125684 Oct 10 12:07:24.166142 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 476/954] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:24 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1204 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:24.538513 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:24.539399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:24.554751 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:24.561036 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:24.561890 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:24.563009 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:24.563644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:24.564279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:24.567456 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:24.568688 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:24.586988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:24.588227 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:24.594061 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:24.595147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:24.595806 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:24.596400 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:25.167318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:25.174088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:25.180791 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a0c11252-d6a4-46c1-a1fb-e1caf6748106 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1319 microversion: 2.1 time: 0.646812 Oct 10 12:07:25.182038 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 479/955] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:24 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:25.185871 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-232aec9e-30f3-431a-87e2-22f9eee4b03b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.623579 Oct 10 12:07:25.190695 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:25.191358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:25.203947 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:25.204799 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 477/956] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:24 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:25.204950 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:25.205260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:25.206001 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:25.206463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:25.207419 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:25.281524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:25.290948 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9f7c188b-56ef-4b27-b5a7-cdf397aa82ad tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1192 microversion: 2.1 time: 0.107776 Oct 10 12:07:25.293140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 480/957] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:25 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:26.204305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:26.205641 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:26.212147 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:26.213405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:26.215791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:26.216894 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:26.218450 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:26.219344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:26.221053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:26.222311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:26.222848 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:26.223258 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:26.223783 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:26.224840 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:26.225501 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:26.226115 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:26.570555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:26.577555 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:26.598382 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-213dad96-eab5-44be-a075-c85ed2892738 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.391286 Oct 10 12:07:26.599566 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4d9f2d43-5a47-4a37-a7fc-c1f020310f7d tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1319 microversion: 2.1 time: 0.396114 Oct 10 12:07:26.600751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 478/958] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:26 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:26.606096 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:26.606340 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 481/959] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:26 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:26.611211 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-34be5585-9728-4ca6-8b74-d3788554e606 req-603cf0e6-2de8-4bb7-bd64-981efdc18de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5a57fa-c3b2-4c18-8ad0-46b13e9ba625", "tag": "ef4352e6-9d9a-4f59-bd5f-87989e5726d5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:26.612039 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:26.628124 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:26.628635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:26.631088 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:26.631839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:26.633508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:26.633950 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:26.634701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-34be5585-9728-4ca6-8b74-d3788554e606 req-603cf0e6-2de8-4bb7-bd64-981efdc18de2 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:26.635222 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-34be5585-9728-4ca6-8b74-d3788554e606 req-603cf0e6-2de8-4bb7-bd64-981efdc18de2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:26.636737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-34be5585-9728-4ca6-8b74-d3788554e606 req-603cf0e6-2de8-4bb7-bd64-981efdc18de2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:26.673487 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-34be5585-9728-4ca6-8b74-d3788554e606 req-603cf0e6-2de8-4bb7-bd64-981efdc18de2 service nova] Creating event network-changed:ef4352e6-9d9a-4f59-bd5f-87989e5726d5 for instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 on hv-cinder-85061 Oct 10 12:07:26.679376 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-34be5585-9728-4ca6-8b74-d3788554e606 req-603cf0e6-2de8-4bb7-bd64-981efdc18de2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071570 Oct 10 12:07:26.680881 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 482/960] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:26.882218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:26.890358 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86a4cd1a-af82-4386-bc74-0271fd0b37c7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.288410 Oct 10 12:07:26.891170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 479/961] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:26 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:27.361898 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f324bdd4-ab1a-4690-8c60-98ef3455739b tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Action: 'create', calling method: .version_select at 0x7f86204dc940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-688032142"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:27.622310 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:27.622952 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:27.630606 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:27.631348 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:27.632008 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:27.633053 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:27.633722 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:27.635394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:27.658367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f324bdd4-ab1a-4690-8c60-98ef3455739b tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.439565 Oct 10 12:07:27.659219 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 483/962] 10.222.0.52 () {60 vars in 1155 bytes} [Mon Oct 10 12:07:27 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 441 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 10 12:07:27.663963 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:27.664916 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:27.673897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:27.674880 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:27.675688 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:27.676869 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:27.677649 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:27.678518 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:27.941023 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:27.944285 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:27.951147 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-961a82f7-f0c9-4f2c-9c23-a325ba1a3e6f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1507 microversion: 2.1 time: 0.290099 Oct 10 12:07:27.951737 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 484/963] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:27 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:27.953018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ab704a8a-32d7-494e-9587-69cc9a4255cc tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.334491 Oct 10 12:07:27.964406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 480/964] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:27 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:27.964406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-13388e0a-be0a-4f35-bdde-287187d5f88a req-dc7f18f9-0a63-4d95-9bee-ac179a0bb282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fe1e01-2c4c-4efa-baa0-09560129a37f", "name": "network-vif-plugged", "status": "completed", "tag": "4ec5973c-48f3-4f05-b8e3-cfca1d4deb74"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:27.969125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8b8b6059-b215-4c0f-8604-efadfe1b8661 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f8620643e50>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:27.974542 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-13388e0a-be0a-4f35-bdde-287187d5f88a req-dc7f18f9-0a63-4d95-9bee-ac179a0bb282 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:27.975134 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-13388e0a-be0a-4f35-bdde-287187d5f88a req-dc7f18f9-0a63-4d95-9bee-ac179a0bb282 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:27.975862 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-13388e0a-be0a-4f35-bdde-287187d5f88a req-dc7f18f9-0a63-4d95-9bee-ac179a0bb282 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:27.990205 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-13388e0a-be0a-4f35-bdde-287187d5f88a req-dc7f18f9-0a63-4d95-9bee-ac179a0bb282 service nova] Creating event network-vif-plugged:4ec5973c-48f3-4f05-b8e3-cfca1d4deb74 for instance d0fe1e01-2c4c-4efa-baa0-09560129a37f on hv-cinder-85061 Oct 10 12:07:27.996742 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-13388e0a-be0a-4f35-bdde-287187d5f88a req-dc7f18f9-0a63-4d95-9bee-ac179a0bb282 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041051 Oct 10 12:07:27.997719 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 481/965] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:28.003487 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:28.004253 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:28.012116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:28.012775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:28.013263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:28.014049 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:28.014758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:28.015317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:28.025703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8b8b6059-b215-4c0f-8604-efadfe1b8661 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e" status: 200 len: 344 microversion: 2.1 time: 0.071978 Oct 10 12:07:28.026278 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 485/966] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:27 2022] GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:28.036467 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ea37387-1ac6-4974-825e-3b0dce9bccbb", "device": "/dev/sdb"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:28.039760 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:28.046637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:28.047752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:28.048481 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:28.049647 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:28.050682 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:28.051200 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:28.175263 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:28.183849 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ec8dca89-681f-479e-9b29-ce51367c7322 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.184788 Oct 10 12:07:28.184418 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 482/967] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:27 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:28.344647 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-23c7ab80-7f6b-4663-b290-4f1f52c994ad tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "POST /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317153 Oct 10 12:07:28.345259 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 486/968] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Oct 10 12:07:28 2022] POST /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:28.976105 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:28.976646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:28.983365 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:28.983856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:28.984297 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:28.984991 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:28.985449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:28.985876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:29.040307 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c89c5830-5825-4c1c-899f-9660be763cb5 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f8620653b80>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:29.092449 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c89c5830-5825-4c1c-899f-9660be763cb5 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e" status: 200 len: 345 microversion: 2.1 time: 0.056214 Oct 10 12:07:29.093107 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 487/969] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:29 2022] GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:07:29.105897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a1edcea0-e7f5-4fff-bea7-ba940f5fd1f2 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Action: 'create', calling method: .version_select at 0x7f86204dcca0>, body: {"snapshot": {"volume_id": "af8f6c23-dd09-470a-a011-cf01c4dcbb0e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1144713782"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:29.124156 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:29.131798 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d330a767-5fd6-482a-a8ff-3c61faf5b38b tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1265 microversion: 2.1 time: 0.159713 Oct 10 12:07:29.132358 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 483/970] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:28 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:29.207476 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:29.208224 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:29.214282 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:29.215031 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:29.215474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:29.216171 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:29.216628 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:29.217055 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:29.262253 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a1edcea0-e7f5-4fff-bea7-ba940f5fd1f2 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.160023 Oct 10 12:07:29.263031 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 488/971] 10.222.0.52 () {60 vars in 1162 bytes} [Mon Oct 10 12:07:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:07:29.274240 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c48c83aa-91c6-4501-92ac-917d8c87d870 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86206aa790>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:29.308221 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c48c83aa-91c6-4501-92ac-917d8c87d870 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 200 len: 287 microversion: 2.1 time: 0.037898 Oct 10 12:07:29.308861 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 489/972] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:29 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:29.321033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-02282be4-fe16-4438-b22a-5f42933ccfed tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86204dc0d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:29.363621 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-02282be4-fe16-4438-b22a-5f42933ccfed tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.046240 Oct 10 12:07:29.365051 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 490/973] 10.222.0.52 () {58 vars in 1140 bytes} [Mon Oct 10 12:07:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:29.376722 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:29.383396 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-996d4acd-1b26-4983-804e-19a6a5d22871 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86204a59d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:29.394704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2c6332af-94cb-44b5-9d44-3edefff013a1 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.191326 Oct 10 12:07:29.395655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 484/974] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:29 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:29.416799 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-996d4acd-1b26-4983-804e-19a6a5d22871 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 200 len: 287 microversion: 2.1 time: 0.037027 Oct 10 12:07:29.417521 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 491/975] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:29 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:07:30.154762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:30.155420 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:30.162207 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:30.162701 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:30.163182 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:30.163883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:30.164345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:30.164774 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:30.297302 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:30.305082 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b63ff1e4-2074-4891-b62c-f31e259fd66f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1452 microversion: 2.1 time: 0.154185 Oct 10 12:07:30.305658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 485/976] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:30 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:30.327931 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:30.329170 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:30.335291 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:30.335772 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:30.336210 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:30.336895 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:30.337954 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:30.338383 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:30.418340 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:30.419226 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:30.425853 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:30.426435 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:30.427000 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:30.427768 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:30.428298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:30.428794 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:30.447466 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:30.468536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:30.477721 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-68c388e4-52f5-42f0-aab5-4243fcba99e6 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1452 microversion: 2.1 time: 0.153994 Oct 10 12:07:30.478483 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 492/977] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:30 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:30.496379 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4af4f199-22d1-41e4-84cd-9aa31d09034a tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f8620653670>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:30.553018 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4af4f199-22d1-41e4-84cd-9aa31d09034a tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 200 len: 287 microversion: 2.1 time: 0.061076 Oct 10 12:07:30.553670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 493/978] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:30 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:30.581135 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:30.589593 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4089b06c-e414-491b-8fd3-1dce1e0a6c9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.175244 Oct 10 12:07:30.590357 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 486/979] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:30 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:31.569223 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e1f6b2bd-d3a5-40f4-9a70-7bef82355bfa tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f8620643550>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:31.578540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:31.579569 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=5 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:31.612005 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e1f6b2bd-d3a5-40f4-9a70-7bef82355bfa tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 200 len: 287 microversion: 2.1 time: 0.048926 Oct 10 12:07:31.612178 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:31.612666 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:31.617457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 494/980] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:31 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:31.619269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:31.619761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:31.620202 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:31.620911 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:31.621362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:31.621844 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:31.751585 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:31.759881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6bbc86f6-f120-4943-a856-244c0e091fd6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.151141 Oct 10 12:07:31.760455 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 487/981] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:31 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:32.017678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-e8f68f9f-a7f7-4b93-8355-ca51cf433181 req-8888063d-f3e9-4d12-a669-240f61d18e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fe1e01-2c4c-4efa-baa0-09560129a37f", "tag": "4ec5973c-48f3-4f05-b8e3-cfca1d4deb74"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:32.030032 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e8f68f9f-a7f7-4b93-8355-ca51cf433181 req-8888063d-f3e9-4d12-a669-240f61d18e7d service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:32.030606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e8f68f9f-a7f7-4b93-8355-ca51cf433181 req-8888063d-f3e9-4d12-a669-240f61d18e7d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:32.031701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e8f68f9f-a7f7-4b93-8355-ca51cf433181 req-8888063d-f3e9-4d12-a669-240f61d18e7d service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:32.042022 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-e8f68f9f-a7f7-4b93-8355-ca51cf433181 req-8888063d-f3e9-4d12-a669-240f61d18e7d service nova] Creating event network-changed:4ec5973c-48f3-4f05-b8e3-cfca1d4deb74 for instance d0fe1e01-2c4c-4efa-baa0-09560129a37f on hv-cinder-85061 Oct 10 12:07:32.047198 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-e8f68f9f-a7f7-4b93-8355-ca51cf433181 req-8888063d-f3e9-4d12-a669-240f61d18e7d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033037 Oct 10 12:07:32.047795 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 495/982] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:32.625082 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91b72852-743c-4589-814c-3145ff282397 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86207bb3a0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:32.633408 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:32.687155 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-91b72852-743c-4589-814c-3145ff282397 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 200 len: 287 microversion: 2.1 time: 0.065822 Oct 10 12:07:32.687731 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 488/983] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:32 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:32.782806 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:32.784068 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:32.791559 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:32.792382 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:32.792989 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:32.793879 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:32.794574 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:32.795208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:32.943122 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:32.951766 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5a99a489-d76c-436a-b90f-e3d47c46ad36 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.173601 Oct 10 12:07:32.954968 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 496/984] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:32 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:33.701374 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-51357c10-a1fa-481b-b4aa-b70c95ac64fb tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f8620ab6940>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:33.736916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-51357c10-a1fa-481b-b4aa-b70c95ac64fb tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 200 len: 288 microversion: 2.1 time: 0.040547 Oct 10 12:07:33.737650 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 489/985] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:33 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:33.748890 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ef53cf6c-fb6a-4250-aae0-747e32b4a42f tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86204dc280>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:33.810439 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ef53cf6c-fb6a-4250-aae0-747e32b4a42f tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 202 len: 0 microversion: 2.1 time: 0.065568 Oct 10 12:07:33.811075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 497/986] 10.222.0.52 () {58 vars in 1254 bytes} [Mon Oct 10 12:07:33 2022] DELETE /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:07:33.819122 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b595826-642d-4f2c-a7fc-628f3a1f67f0 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86207b18b0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:33.850289 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b595826-642d-4f2c-a7fc-628f3a1f67f0 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 200 len: 287 microversion: 2.1 time: 0.035031 Oct 10 12:07:33.850882 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 490/987] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:33 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:33.975256 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:33.975800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:33.981637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:33.982125 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:33.982565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:33.983289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:33.983748 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:33.984171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:34.114187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:34.122386 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-90f08741-ebb8-47f0-b8f6-2fb7e7632f44 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.151087 Oct 10 12:07:34.122957 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 498/988] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:33 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:34.863496 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dd51e5bb-2054-4978-9b97-c09124dc5309 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86207f5940>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:34.888444 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-dd51e5bb-2054-4978-9b97-c09124dc5309 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] HTTP exception thrown: Snapshot 897f4987-cc1a-4962-a8d7-b6dd9868addd could not be found. Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dd51e5bb-2054-4978-9b97-c09124dc5309 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Request method failure captured: Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd HTTP/1.1 Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAr_Bt4ASthWKvrli_CQmOEo-6mt90dSJAqZ6H8mcp7FbXsppQPXxe3oBSxpYoWP-BzrE9nWhH1DLOGyN9KVfAsHAWMl_PM7xzy5d7lbrUfae7cXdLqINUdrDQTx_Svc6Z9wTOuccZ1Y2za45WyeLbyvSslicE3QGAYVs5UDfyvfdmE Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:07:34.890777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d7a6a489452a49399c80d7bd29a07031", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}] Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: e1cf6ac02a39435f95d0cb8ead6de1bb Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Snapshot 897f4987-cc1a-4962-a8d7-b6dd9868addd could not be found. Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '897f4987-cc1a-4962-a8d7-b6dd9868addd'} Oct 10 12:07:34.892527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 897f4987-cc1a-4962-a8d7-b6dd9868addd could not be found. (HTTP 404) (Request-ID: req-b33e6afb-21d5-4fd0-9848-5c0eda7ce8a4) Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:34.893690 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:34.895170 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 897f4987-cc1a-4962-a8d7-b6dd9868addd could not be found. Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 10 12:07:34.896658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 897f4987-cc1a-4962-a8d7-b6dd9868addd could not be found. Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 897f4987-cc1a-4962-a8d7-b6dd9868addd could not be found. Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dd51e5bb-2054-4978-9b97-c09124dc5309 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Returning 404 to user: Snapshot 897f4987-cc1a-4962-a8d7-b6dd9868addd could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:34.898341 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dd51e5bb-2054-4978-9b97-c09124dc5309 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd" status: 404 len: 111 microversion: 2.1 time: 0.033103 Oct 10 12:07:34.899412 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 491/989] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:07:34 2022] GET /compute/v2.1/os-snapshots/897f4987-cc1a-4962-a8d7-b6dd9868addd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:34.900855 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b7ec944-a1b3-4542-9802-043fbbd7a2ad tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86204dcc10>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:34.960430 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1b7ec944-a1b3-4542-9802-043fbbd7a2ad tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e" status: 202 len: 0 microversion: 2.1 time: 0.063294 Oct 10 12:07:34.960992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 499/990] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:07:34 2022] DELETE /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:07:34.969363 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4002689a-e550-4387-91fd-d77308f368a4 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86207bb4c0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:35.017168 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4002689a-e550-4387-91fd-d77308f368a4 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e" status: 200 len: 344 microversion: 2.1 time: 0.051860 Oct 10 12:07:35.017732 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 492/991] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:34 2022] GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:35.145885 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:35.146519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:35.152587 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:35.153075 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:35.153512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:35.154206 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:35.154667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:35.155120 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:35.283904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:35.292185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-239b3ab5-1aab-4c16-975b-c710f70e46b4 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.150146 Oct 10 12:07:35.292747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 500/992] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:35 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:36.030969 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3285f4b2-7039-4767-be98-14e88265e69d tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86207bb3a0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:36.059342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-3285f4b2-7039-4767-be98-14e88265e69d tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] HTTP exception thrown: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3285f4b2-7039-4767-be98-14e88265e69d tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Request method failure captured: Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e HTTP/1.1 Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAr_Bt4ASthWKvrli_CQmOEo-6mt90dSJAqZ6H8mcp7FbXsppQPXxe3oBSxpYoWP-BzrE9nWhH1DLOGyN9KVfAsHAWMl_PM7xzy5d7lbrUfae7cXdLqINUdrDQTx_Svc6Z9wTOuccZ1Y2za45WyeLbyvSslicE3QGAYVs5UDfyvfdmE Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:07:36.061295 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d7a6a489452a49399c80d7bd29a07031", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}] Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: e1cf6ac02a39435f95d0cb8ead6de1bb Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'af8f6c23-dd09-470a-a011-cf01c4dcbb0e'} Oct 10 12:07:36.062942 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. (HTTP 404) (Request-ID: req-d3b28a3b-0a8e-41a4-88dc-48454a80291b) Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.064051 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:36.065613 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 12:07:36.067151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3285f4b2-7039-4767-be98-14e88265e69d tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Returning 404 to user: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3285f4b2-7039-4767-be98-14e88265e69d tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e" status: 404 len: 109 microversion: 2.1 time: 0.035811 Oct 10 12:07:36.068767 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 493/993] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:36 2022] GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:36.073387 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-de091e84-324f-41ea-a304-3eedf3609d41 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f86206c5040>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:36.100366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-de091e84-324f-41ea-a304-3eedf3609d41 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] HTTP exception thrown: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-de091e84-324f-41ea-a304-3eedf3609d41 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Request method failure captured: Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e HTTP/1.1 Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAr_Bt4ASthWKvrli_CQmOEo-6mt90dSJAqZ6H8mcp7FbXsppQPXxe3oBSxpYoWP-BzrE9nWhH1DLOGyN9KVfAsHAWMl_PM7xzy5d7lbrUfae7cXdLqINUdrDQTx_Svc6Z9wTOuccZ1Y2za45WyeLbyvSslicE3QGAYVs5UDfyvfdmE Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:07:36.102464 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d7a6a489452a49399c80d7bd29a07031", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}] Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: e1cf6ac02a39435f95d0cb8ead6de1bb Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': 'af8f6c23-dd09-470a-a011-cf01c4dcbb0e'} Oct 10 12:07:36.104689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. (HTTP 404) (Request-ID: req-9bcb0a7f-72da-4488-b33a-75c131ad226f) Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.105873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:07:36.107404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 12:07:36.109011 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-de091e84-324f-41ea-a304-3eedf3609d41 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Returning 404 to user: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-de091e84-324f-41ea-a304-3eedf3609d41 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e" status: 404 len: 109 microversion: 2.1 time: 0.034930 Oct 10 12:07:36.110473 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 501/994] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Oct 10 12:07:36 2022] DELETE /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:36.112620 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-76e9796f-c6a6-468c-a955-44244abf4ea6 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Calling method '.version_select at 0x7f8620b73f70>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:36.141057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-76e9796f-c6a6-468c-a955-44244abf4ea6 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] HTTP exception thrown: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-76e9796f-c6a6-468c-a955-44244abf4ea6 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Request method failure captured: Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e HTTP/1.1 Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAr_Bt4ASthWKvrli_CQmOEo-6mt90dSJAqZ6H8mcp7FbXsppQPXxe3oBSxpYoWP-BzrE9nWhH1DLOGyN9KVfAsHAWMl_PM7xzy5d7lbrUfae7cXdLqINUdrDQTx_Svc6Z9wTOuccZ1Y2za45WyeLbyvSslicE3QGAYVs5UDfyvfdmE Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:07:36.143013 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d7a6a489452a49399c80d7bd29a07031", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d7a6a489452a49399c80d7bd29a07031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7a6a489452a49399c80d7bd29a07031"}]}] Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: d7a6a489452a49399c80d7bd29a07031 Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023209506 Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: e1cf6ac02a39435f95d0cb8ead6de1bb Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023209506-project Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'af8f6c23-dd09-470a-a011-cf01c4dcbb0e'} Oct 10 12:07:36.144695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. (HTTP 404) (Request-ID: req-f1611d98-1a51-45ce-b176-d3440ee243a9) Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.145646 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:36.147116 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 12:07:36.148511 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-76e9796f-c6a6-468c-a955-44244abf4ea6 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] Returning 404 to user: Volume af8f6c23-dd09-470a-a011-cf01c4dcbb0e could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-76e9796f-c6a6-468c-a955-44244abf4ea6 tempest-VolumesSnapshotsTestJSON-1023209506 tempest-VolumesSnapshotsTestJSON-1023209506-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e" status: 404 len: 109 microversion: 2.1 time: 0.035542 Oct 10 12:07:36.150029 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 494/995] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:36 2022] GET /compute/v2.1/os-volumes/af8f6c23-dd09-470a-a011-cf01c4dcbb0e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:36.316288 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:36.317311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:36.324525 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:36.325014 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:36.325670 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:36.327110 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:36.327634 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:36.328017 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:36.480207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:36.488087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-891b3236-069e-4922-842a-9cc293a01b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.175578 Oct 10 12:07:36.488956 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 502/996] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:36 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:37.513198 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:37.513808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:37.520290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:37.520775 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:37.521205 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:37.521899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:37.522353 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:37.522805 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:37.655925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:37.663736 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5daac76f-30c1-4863-871a-5d79fe5abe61 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.155617 Oct 10 12:07:37.664408 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 495/997] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:37 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:37.916915 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-6213ee97-960e-42aa-9e94-fe6685234485 req-bbe75a99-0761-4499-9c4e-181d73031f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5a57fa-c3b2-4c18-8ad0-46b13e9ba625", "name": "network-vif-plugged", "status": "completed", "tag": "ef4352e6-9d9a-4f59-bd5f-87989e5726d5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:37.927965 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6213ee97-960e-42aa-9e94-fe6685234485 req-bbe75a99-0761-4499-9c4e-181d73031f9b service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:37.928448 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6213ee97-960e-42aa-9e94-fe6685234485 req-bbe75a99-0761-4499-9c4e-181d73031f9b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:37.928899 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6213ee97-960e-42aa-9e94-fe6685234485 req-bbe75a99-0761-4499-9c4e-181d73031f9b service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:37.940939 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:37.943395 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-6213ee97-960e-42aa-9e94-fe6685234485 req-bbe75a99-0761-4499-9c4e-181d73031f9b service nova] Creating event network-vif-plugged:ef4352e6-9d9a-4f59-bd5f-87989e5726d5 for instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 on hv-cinder-85061 Oct 10 12:07:37.948440 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-6213ee97-960e-42aa-9e94-fe6685234485 req-bbe75a99-0761-4499-9c4e-181d73031f9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035928 Oct 10 12:07:37.949112 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 503/998] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:07:38.687631 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:38.688275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:38.694741 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:38.695257 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:38.695698 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:38.696394 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:38.696854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:38.697284 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:38.825065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:38.832984 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2aa68488-01b3-45c6-83a9-2bb29702adf0 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1259 microversion: 2.1 time: 0.149251 Oct 10 12:07:38.833562 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 496/999] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:38 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:38.920410 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-54507f11-c708-4d43-a70a-dc24a5f4d4f2 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f86206c5d30>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:38.968130 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-54507f11-c708-4d43-a70a-dc24a5f4d4f2 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/59626d27-cf61-4509-adba-f005d7922b04" status: 200 len: 351 microversion: 2.1 time: 0.052579 Oct 10 12:07:38.968696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 504/1000] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:38 2022] GET /compute/v2.1/os-volumes/59626d27-cf61-4509-adba-f005d7922b04 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:39.856877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:39.857482 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:39.864331 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:39.864799 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:39.865230 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:39.865906 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:39.866352 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:39.866772 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:39.998813 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:40.006597 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5afff1fb-91a6-4ba4-94b1-a07f13974e9f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1444 microversion: 2.1 time: 0.153573 Oct 10 12:07:40.007247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 497/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:39 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:40.029540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:40.030283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:40.037242 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:40.037769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:40.038248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:40.039082 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:40.039541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:40.039969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:40.174020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:40.181782 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f7287fc5-1627-4886-94c5-526b68ffd34a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1444 microversion: 2.1 time: 0.157010 Oct 10 12:07:40.182339 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 505/1002] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:40 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:40.303269 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8a72915b-b91e-4928-b4da-8f2a212b6478 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f8620922820>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:40.349843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8a72915b-b91e-4928-b4da-8f2a212b6478 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d7f44d40-7511-42a0-8675-a60e61370087" status: 200 len: 350 microversion: 2.1 time: 0.050679 Oct 10 12:07:40.350411 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 498/1003] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:40 2022] GET /compute/v2.1/os-volumes/d7f44d40-7511-42a0-8675-a60e61370087 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:41.757257 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dedca64a-313c-4e95-b102-5e462ac417eb tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f86204dc0d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:41.804612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dedca64a-313c-4e95-b102-5e462ac417eb tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1f4e221c-dcdd-4d58-be30-ffc7706ba6ae" status: 200 len: 351 microversion: 2.1 time: 0.051089 Oct 10 12:07:41.805187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 506/1004] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:41 2022] GET /compute/v2.1/os-volumes/1f4e221c-dcdd-4d58-be30-ffc7706ba6ae => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:41.819262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1c82ba7f-af36-445e-ab10-de62bdc870bf tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f8620a5e0d0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:41.901543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1c82ba7f-af36-445e-ab10-de62bdc870bf tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086518 Oct 10 12:07:41.902123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 499/1005] 10.222.0.52 () {58 vars in 1134 bytes} [Mon Oct 10 12:07:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:41.915953 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bca3ac64-8d4d-4032-ad63-349f1c9441ae tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f86206aa5e0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:41.998619 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bca3ac64-8d4d-4032-ad63-349f1c9441ae tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086408 Oct 10 12:07:41.999297 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 507/1006] 10.222.0.52 () {58 vars in 1149 bytes} [Mon Oct 10 12:07:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:42.013780 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a3479048-8616-4872-8dd3-a2a8b9afc337 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f8620412310>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.096176 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a3479048-8616-4872-8dd3-a2a8b9afc337 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086817 Oct 10 12:07:42.096758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 500/1007] 10.222.0.52 () {58 vars in 1134 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:42.110459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-56157d0e-62c8-41f3-b0af-729a5c537ada tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f86207019d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.197813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-56157d0e-62c8-41f3-b0af-729a5c537ada tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091166 Oct 10 12:07:42.198385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 508/1008] 10.222.0.52 () {58 vars in 1167 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:42.211744 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6cc6bfc4-7a20-4d25-9197-4a456f63c272 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f86205f3700>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.298971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-0b099d4c-a23d-4f02-9454-1c3b348917f5 req-33b1260d-4b8c-4e45-bb88-1b44088e2074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5a57fa-c3b2-4c18-8ad0-46b13e9ba625", "tag": "ef4352e6-9d9a-4f59-bd5f-87989e5726d5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:42.300990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6cc6bfc4-7a20-4d25-9197-4a456f63c272 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092968 Oct 10 12:07:42.301984 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 501/1009] 10.222.0.52 () {58 vars in 1170 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:42.309858 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0b099d4c-a23d-4f02-9454-1c3b348917f5 req-33b1260d-4b8c-4e45-bb88-1b44088e2074 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:42.310444 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0b099d4c-a23d-4f02-9454-1c3b348917f5 req-33b1260d-4b8c-4e45-bb88-1b44088e2074 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:42.311136 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0b099d4c-a23d-4f02-9454-1c3b348917f5 req-33b1260d-4b8c-4e45-bb88-1b44088e2074 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:42.316276 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e3f2b18e-a439-4211-af3f-e3ddca19cfe6 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f8620967c10>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.322440 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-0b099d4c-a23d-4f02-9454-1c3b348917f5 req-33b1260d-4b8c-4e45-bb88-1b44088e2074 service nova] Creating event network-changed:ef4352e6-9d9a-4f59-bd5f-87989e5726d5 for instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 on hv-cinder-85061 Oct 10 12:07:42.327733 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-0b099d4c-a23d-4f02-9454-1c3b348917f5 req-33b1260d-4b8c-4e45-bb88-1b44088e2074 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Oct 10 12:07:42.328392 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 509/1010] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:07:42.407902 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e3f2b18e-a439-4211-af3f-e3ddca19cfe6 tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095762 Oct 10 12:07:42.408573 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 502/1011] 10.222.0.52 () {58 vars in 1155 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:07:42.423296 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c83c7824-972c-450b-995a-faabc073668b tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f86206b6e50>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.507552 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c83c7824-972c-450b-995a-faabc073668b tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088681 Oct 10 12:07:42.508140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 510/1012] 10.222.0.52 () {58 vars in 1188 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:42.522082 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-68c7f5bd-b8f4-4357-acde-d9c64530714c tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] Calling method '.version_select at 0x7f862078f160>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.603390 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-68c7f5bd-b8f4-4357-acde-d9c64530714c tempest-VolumesTestJSON-1914326364 tempest-VolumesTestJSON-1914326364-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084955 Oct 10 12:07:42.604070 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 503/1013] 10.222.0.52 () {58 vars in 1155 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:53.061045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:53.061787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=8 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:53.066063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:53.066659 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:53.075421 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:53.075897 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:53.076337 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:53.077046 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:53.077497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:53.077922 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:53.161653 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lazy-loading 'services' on Instance uuid aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:07:53.236907 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b840268a-6fbf-44c0-aefb-d5e962f81a26 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1/os-volume_attachments/7ea37387-1ac6-4974-825e-3b0dce9bccbb" status: 202 len: 0 microversion: 2.1 time: 0.177186 Oct 10 12:07:53.237524 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 511/1014] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Oct 10 12:07:53 2022] DELETE /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1/os-volume_attachments/7ea37387-1ac6-4974-825e-3b0dce9bccbb => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:07:55.419541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=31 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:55.420316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=26 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:55.424837 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:55.425338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:55.432279 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:55.432766 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:55.433211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:55.433905 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:55.434372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:55.434799 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:55.459680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:07:55.531987 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c55751d-37c9-4781-803e-07f78e9e9095 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 204 len: 0 microversion: 2.1 time: 0.113594 Oct 10 12:07:55.532578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 504/1015] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:07:55 2022] DELETE /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:07:55.541973 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:55.542684 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:55.549460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:55.549982 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:55.550416 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:55.551155 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:55.551613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:55.552041 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:55.679689 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:55.687447 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-90817f6f-a318-4b87-889a-3ca1ba90d429 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1513 microversion: 2.1 time: 0.150384 Oct 10 12:07:55.688007 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 512/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:55 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:56.711751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:56.712454 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:56.719609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:56.720087 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:56.720517 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:56.721225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:56.721678 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:56.722093 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:56.859699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:56.867624 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0c5970b0-edb0-452e-877c-a9b45aefa0a1 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1513 microversion: 2.1 time: 0.160363 Oct 10 12:07:56.868204 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 505/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:56 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:57.890911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:57.891617 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:57.898800 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:57.899428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:57.899957 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:57.900761 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:57.901279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:57.901771 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:58.107180 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:58.115678 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca391f8b-5bd5-41de-8136-14dd4724ac11 tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1513 microversion: 2.1 time: 0.229342 Oct 10 12:07:58.116480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 513/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:57 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:07:58.295278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c3eaaf9e-1d20-4f4a-b623-097bceb417d7 req-0b088a76-2254-4ebd-b17c-88a511220b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa66ebde-6b02-4f5d-b8a5-acc9daf624a1", "name": "network-vif-deleted", "tag": "c9490bd5-97d9-47e7-aa61-0a0706797b45"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:58.306401 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c3eaaf9e-1d20-4f4a-b623-097bceb417d7 req-0b088a76-2254-4ebd-b17c-88a511220b61 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:58.306956 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c3eaaf9e-1d20-4f4a-b623-097bceb417d7 req-0b088a76-2254-4ebd-b17c-88a511220b61 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:58.307458 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c3eaaf9e-1d20-4f4a-b623-097bceb417d7 req-0b088a76-2254-4ebd-b17c-88a511220b61 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:58.319362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c3eaaf9e-1d20-4f4a-b623-097bceb417d7 req-0b088a76-2254-4ebd-b17c-88a511220b61 service nova] Creating event network-vif-deleted:c9490bd5-97d9-47e7-aa61-0a0706797b45 for instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 on hv-cinder-85061 Oct 10 12:07:58.325393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c3eaaf9e-1d20-4f4a-b623-097bceb417d7 req-0b088a76-2254-4ebd-b17c-88a511220b61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034048 Oct 10 12:07:58.326508 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 506/1019] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:59.139438 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:59.140047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:07:59.146208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:59.146687 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:59.147155 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:59.148030 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:59.148522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:59.148944 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:59.180439 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:07:59.180921 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:07:59.181354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:07:59.181796 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lazy-loading 'fault' on Instance uuid aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:07:59.228971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243f437de8b439984375303ff49f9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0223b57233664d0785c96ec98335e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:07:59.237889 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b82d1eb5-ba45-4dbd-8414-e22c9bbbf56a tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 200 len: 1309 microversion: 2.1 time: 0.102248 Oct 10 12:07:59.238458 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 514/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:07:59 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:00.262812 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:00.263627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] [instance: aa66ebde-6b02-4f5d-b8a5-acc9daf624a1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:00.270034 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:00.270521 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:00.270978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:00.271672 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:00.272127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:00.272553 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:00.288447 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] HTTP exception thrown: Instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 could not be found. Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Request method failure captured: Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 HTTP/1.1 Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAqI_eac4zGTmDVT0YhOudAkTBHtq9ptzL-Gbh26E9hW5RQUMy2D-0clPMsgLNEDL_bkG5mSlb5Wxf-AHtyMoWXSXTbJYTQetyABzW_0xvNfJiUuWw7z7ic9frLLVVIMvJ9lWifuPR5dEMDm57w394O9gJydXAi5j2LyRtEoMTomGA4 Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 0223b57233664d0785c96ec98335e307 Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1021339458 Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:08:00.290339 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0223b57233664d0785c96ec98335e307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0223b57233664d0785c96ec98335e307", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0223b57233664d0785c96ec98335e307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0223b57233664d0785c96ec98335e307"}]}] Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotTestJSON-1021339458 Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0223b57233664d0785c96ec98335e307 Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1021339458 Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotTestJSON-1021339458-project Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: 0243f437de8b439984375303ff49f9e3 Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotTestJSON-1021339458-project Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 could not be found. Oct 10 12:08:00.292262 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'aa66ebde-6b02-4f5d-b8a5-acc9daf624a1'} Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 could not be found. Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:08:00.293237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 could not be found. Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 could not be found. Oct 10 12:08:00.295502 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:08:00.297225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] Returning 404 to user: Instance aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:08:00.297225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4bb070a1-abbb-478a-a919-414e7d6dcb5f tempest-VolumesSnapshotTestJSON-1021339458 tempest-VolumesSnapshotTestJSON-1021339458-project] 10.222.0.52 "GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1" status: 404 len: 111 microversion: 2.1 time: 0.033861 Oct 10 12:08:00.297225 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 507/1021] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:00 2022] GET /compute/v2.1/servers/aa66ebde-6b02-4f5d-b8a5-acc9daf624a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:08:07.596549 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-504603461", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "networks": [{"uuid": "679c2eaa-80b6-40c1-a8eb-e8ad03f5e868"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:07.650547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] validate_networks() for [('679c2eaa-80b6-40c1-a8eb-e8ad03f5e868', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:08:07.997644 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:07.998062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:07.998532 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:07.999028 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:07.999433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:08.007971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.008450 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.008878 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.009592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.010047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.010463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.027203 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Getting quotas for project 38aeafae184a4a35859c9e11d25e2aff. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:08.031108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Getting quotas for user 73c0a56653d8404f87b760decb8c2f89 and project 38aeafae184a4a35859c9e11d25e2aff. Resources: {'cores', 'instances', 'ram'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:08.041650 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:08.043945 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:08.088355 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8b05afab-3a22-48b7-88b4-e4eaa35ceb87 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495588 Oct 10 12:08:08.089350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 515/1022] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:08:08.100298 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f6dce530-d1ed-4c44-91be-c31ade396242 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:08.101001 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f6dce530-d1ed-4c44-91be-c31ade396242 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:08.154592 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f6dce530-d1ed-4c44-91be-c31ade396242 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:08.161362 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f6dce530-d1ed-4c44-91be-c31ade396242 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1213 microversion: 2.1 time: 0.065184 Oct 10 12:08:08.161931 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 508/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:08 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:09.185480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:09.186201 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:09.196703 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.197358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.197924 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.198749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.199268 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.200519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.279904 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:09.288767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cc1dc614-fb2d-4056-8606-65e298e3c063 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1273 microversion: 2.1 time: 0.107169 Oct 10 12:08:09.298813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 516/1024] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:09 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:10.311564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:10.312177 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:10.314686 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:10.321725 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:10.322372 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:10.322802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:10.323555 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:10.324035 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:10.325213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:10.525814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:10.534153 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-439fcc4e-8da2-4da2-b4ec-6d9c57d82bbc tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.226450 Oct 10 12:08:10.534728 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 509/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:10 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:10.661209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-697da903-810b-474f-9fbb-e7a767728eea req-b1ed7973-964c-440b-b710-f1537c02a255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc68470f-7631-4dcb-8477-96f5bac19e56", "tag": "a2f2cc51-dde0-4b68-8a46-13b7a3b6e940"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:10.671423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-697da903-810b-474f-9fbb-e7a767728eea req-b1ed7973-964c-440b-b710-f1537c02a255 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:10.671910 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-697da903-810b-474f-9fbb-e7a767728eea req-b1ed7973-964c-440b-b710-f1537c02a255 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:10.672339 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-697da903-810b-474f-9fbb-e7a767728eea req-b1ed7973-964c-440b-b710-f1537c02a255 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:10.683151 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-697da903-810b-474f-9fbb-e7a767728eea req-b1ed7973-964c-440b-b710-f1537c02a255 service nova] Creating event network-changed:a2f2cc51-dde0-4b68-8a46-13b7a3b6e940 for instance dc68470f-7631-4dcb-8477-96f5bac19e56 on hv-cinder-85061 Oct 10 12:08:10.688347 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-697da903-810b-474f-9fbb-e7a767728eea req-b1ed7973-964c-440b-b710-f1537c02a255 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030942 Oct 10 12:08:10.689204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 517/1026] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:11.557241 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:11.557847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:11.564793 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:11.565267 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:11.565698 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:11.566378 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:11.566828 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:11.567274 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:11.693722 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:11.701822 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-37b04238-b459-48e8-a8c4-81f4fd785746 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.148446 Oct 10 12:08:11.702382 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 510/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:11 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:12.725432 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:12.726057 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:12.732715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:12.733193 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:12.733624 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:12.734303 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:12.734753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:12.735209 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:12.862249 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:12.869780 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8e70c950-5686-4ccb-958f-5bade43172ac tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.149094 Oct 10 12:08:12.870367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 518/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:12 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:13.893578 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:13.894255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:13.900655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.901142 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.901579 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:13.902354 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.902809 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.903264 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:14.082796 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:14.090770 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ef4a32da-822c-4331-a572-2d9428aa9a1b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.201221 Oct 10 12:08:14.091373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 511/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:13 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:15.113541 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:15.114151 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:15.120731 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:15.121243 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:15.121696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:15.122362 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:15.122827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:15.123272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:15.262793 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.270351 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cead54ea-17bf-4cb2-84ba-070da01b6a99 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.160702 Oct 10 12:08:15.270930 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 519/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:15 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:16.292525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:16.293066 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:16.299811 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:16.300273 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:16.300714 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:16.301397 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:16.301852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:16.302274 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:16.430970 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:16.438569 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1a82b105-b1f9-402f-90e4-a67d89cc5a10 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.150062 Oct 10 12:08:16.439165 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 512/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:16 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:17.463264 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:17.463824 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:17.470685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:17.471202 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:17.471651 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:17.472359 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:17.472859 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:17.473298 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:17.603884 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:17.612187 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cbc67487-2135-4b71-8821-0a3afad6a5bd tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.152914 Oct 10 12:08:17.612769 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 520/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:17 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:18.633506 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:18.634146 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:18.636528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:18.642006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.642487 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.642937 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:18.643626 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.644079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.644503 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.048778 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:19.063047 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46c16f9f-0742-44ea-897e-f852e8a3ad3a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.433294 Oct 10 12:08:19.063632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 513/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:18 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:19.128201 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-516bf943-cc4f-44e9-b205-13b467603597 req-8373a309-5896-4950-bd30-437bf1bcf405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc68470f-7631-4dcb-8477-96f5bac19e56", "name": "network-vif-plugged", "status": "completed", "tag": "a2f2cc51-dde0-4b68-8a46-13b7a3b6e940"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:19.133248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:19.133920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:19.141336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-516bf943-cc4f-44e9-b205-13b467603597 req-8373a309-5896-4950-bd30-437bf1bcf405 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:19.141827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-516bf943-cc4f-44e9-b205-13b467603597 req-8373a309-5896-4950-bd30-437bf1bcf405 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:19.142272 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-516bf943-cc4f-44e9-b205-13b467603597 req-8373a309-5896-4950-bd30-437bf1bcf405 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.153318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-516bf943-cc4f-44e9-b205-13b467603597 req-8373a309-5896-4950-bd30-437bf1bcf405 service nova] Creating event network-vif-plugged:a2f2cc51-dde0-4b68-8a46-13b7a3b6e940 for instance dc68470f-7631-4dcb-8477-96f5bac19e56 on hv-cinder-85061 Oct 10 12:08:19.158164 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-516bf943-cc4f-44e9-b205-13b467603597 req-8373a309-5896-4950-bd30-437bf1bcf405 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Oct 10 12:08:19.158935 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 521/1034] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:20.085328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:20.085961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:20.092319 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:20.093539 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:20.093983 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:20.094658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:20.095138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:20.095568 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:20.226115 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:20.233887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-304b5d68-69e4-449e-973d-7eba824cbefe tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1313 microversion: 2.1 time: 0.152334 Oct 10 12:08:20.234448 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 514/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:20 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:21.256536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:21.257214 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:21.263327 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:21.263812 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:21.264580 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:21.264978 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:21.265433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:21.265862 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:21.400131 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:21.410064 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6f9e3112-af1d-4f43-90db-f47bd317ee3b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1497 microversion: 2.1 time: 0.157767 Oct 10 12:08:21.410374 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 522/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:21 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:22.074461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:22.074989 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:22.082127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.082616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.083091 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.083791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.084250 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.084677 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.109713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:08:22.187089 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-336c2625-7d05-40f5-8d57-e5d135445b69 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 204 len: 0 microversion: 2.1 time: 0.115499 Oct 10 12:08:22.187782 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 515/1037] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:08:22 2022] DELETE /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:08:22.196428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:22.196950 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:22.203390 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.203872 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.204299 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.204984 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.205433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.205854 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.333997 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:22.341632 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bfd39441-dc1d-4454-8619-c241d6aba863 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1503 microversion: 2.1 time: 0.149280 Oct 10 12:08:22.342190 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 523/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:22 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:23.365497 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:23.366237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:23.372641 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.373123 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.373558 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.374749 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.375237 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.375661 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.507528 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:23.515778 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fcb7c9ce-0bd5-472b-b8fa-db90b7d05706 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1503 microversion: 2.1 time: 0.154669 Oct 10 12:08:23.516346 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 516/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:23 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:24.468902 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-bc7732dd-5ba3-4c1c-99b6-68d404160c7a req-451ee7af-d429-4264-910e-79ee261a4529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc68470f-7631-4dcb-8477-96f5bac19e56", "name": "network-vif-deleted", "tag": "a2f2cc51-dde0-4b68-8a46-13b7a3b6e940"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:24.475987 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:24.484241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bc7732dd-5ba3-4c1c-99b6-68d404160c7a req-451ee7af-d429-4264-910e-79ee261a4529 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.485085 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bc7732dd-5ba3-4c1c-99b6-68d404160c7a req-451ee7af-d429-4264-910e-79ee261a4529 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.485799 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bc7732dd-5ba3-4c1c-99b6-68d404160c7a req-451ee7af-d429-4264-910e-79ee261a4529 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.490715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:24.501728 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-bc7732dd-5ba3-4c1c-99b6-68d404160c7a req-451ee7af-d429-4264-910e-79ee261a4529 service nova] Creating event network-vif-deleted:a2f2cc51-dde0-4b68-8a46-13b7a3b6e940 for instance dc68470f-7631-4dcb-8477-96f5bac19e56 on hv-cinder-85061 Oct 10 12:08:24.506522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-bc7732dd-5ba3-4c1c-99b6-68d404160c7a req-451ee7af-d429-4264-910e-79ee261a4529 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044592 Oct 10 12:08:24.507362 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 524/1040] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:24.538655 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:24.539333 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:24.547516 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.548272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.548704 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.549406 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.549857 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.550277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.617506 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:24.626216 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2e567a57-7fd6-4188-aa3d-03ca50e3aa2e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 200 len: 1298 microversion: 2.1 time: 0.091933 Oct 10 12:08:24.626963 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 517/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:24 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:25.650574 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:25.651320 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: dc68470f-7631-4dcb-8477-96f5bac19e56] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:25.658685 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.659140 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.659585 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.660280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.660739 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.661171 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.674775 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] HTTP exception thrown: Instance dc68470f-7631-4dcb-8477-96f5bac19e56 could not be found. Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Request method failure captured: Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 HTTP/1.1 Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAsmkIAmud1RCtxo-1s8xdFK3WAPupw7Fyx2mDoIKuEL_2717ylYAbxTafokTbsq20idnw-x8yGWdEtoYI1UHmp0C3zfHPd9QnB7ylsd5gzwX3yxr3i_kRzpPm09LLDd6J51JnDuBu7hbuk1fef_69zWtuP1okV9caUnuKlYM-VgJzg Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 38aeafae184a4a35859c9e11d25e2aff Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesActionsTest-2000386982 Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:08:25.676394 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38aeafae184a4a35859c9e11d25e2aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_38aeafae184a4a35859c9e11d25e2aff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/38aeafae184a4a35859c9e11d25e2aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38aeafae184a4a35859c9e11d25e2aff"}]}] Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesActionsTest-2000386982 Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 38aeafae184a4a35859c9e11d25e2aff Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesActionsTest-2000386982 Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesActionsTest-2000386982-project Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 73c0a56653d8404f87b760decb8c2f89 Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesActionsTest-2000386982-project Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance dc68470f-7631-4dcb-8477-96f5bac19e56 could not be found. Oct 10 12:08:25.678121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': 'dc68470f-7631-4dcb-8477-96f5bac19e56'} Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc68470f-7631-4dcb-8477-96f5bac19e56 could not be found. Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:08:25.679271 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc68470f-7631-4dcb-8477-96f5bac19e56 could not be found. Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc68470f-7631-4dcb-8477-96f5bac19e56 could not be found. Oct 10 12:08:25.680920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:25.682460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Returning 404 to user: Instance dc68470f-7631-4dcb-8477-96f5bac19e56 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:08:25.682460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c935c8d9-3680-4127-978a-36c1ab7a7d2b tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56" status: 404 len: 111 microversion: 2.1 time: 0.032332 Oct 10 12:08:25.682460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 525/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:25 2022] GET /compute/v2.1/servers/dc68470f-7631-4dcb-8477-96f5bac19e56 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:08:25.826526 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-977290191", "imageRef": "904cdf63-e045-4a97-9144-8b60936d30c8", "flavorRef": "452", "networks": [{"uuid": "679c2eaa-80b6-40c1-a8eb-e8ad03f5e868"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:25.835343 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:25.879843 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] validate_networks() for [('679c2eaa-80b6-40c1-a8eb-e8ad03f5e868', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:08:26.220377 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:26.220835 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:26.221307 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:26.221717 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:26.222128 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:26.231639 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.232125 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.232560 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.233307 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.233764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.234194 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.250587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Getting quotas for project 38aeafae184a4a35859c9e11d25e2aff. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:26.254461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Getting quotas for user 73c0a56653d8404f87b760decb8c2f89 and project 38aeafae184a4a35859c9e11d25e2aff. Resources: {'cores', 'instances', 'ram'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:26.265662 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:26.267955 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='904cdf63-e045-4a97-9144-8b60936d30c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:26.312283 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7f03c4f3-31e3-429c-8c92-6c4afc3f2351 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489553 Oct 10 12:08:26.312925 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 518/1043] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Oct 10 12:08:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:08:26.323906 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-122cb9c2-9fa1-4efb-a182-b44ea047c79c tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:26.324515 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-122cb9c2-9fa1-4efb-a182-b44ea047c79c tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:26.378930 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-122cb9c2-9fa1-4efb-a182-b44ea047c79c tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:26.385747 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-122cb9c2-9fa1-4efb-a182-b44ea047c79c tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1213 microversion: 2.1 time: 0.065658 Oct 10 12:08:26.386302 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 526/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:26 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:27.409219 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:27.409825 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:27.416759 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.417238 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.417846 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:27.418716 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.419193 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.419616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:27.524477 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:27.532847 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7905d28c-1c9b-4904-ab0e-8d328f4e2ecf tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1273 microversion: 2.1 time: 0.127946 Oct 10 12:08:27.533778 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 519/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:27 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:28.560616 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:28.561238 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:28.568882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.569375 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.569821 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.570522 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.571021 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.571480 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.760654 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.769313 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-621a32ed-6f40-4187-9cbb-07601e7ca742 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.212560 Oct 10 12:08:28.769893 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 527/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:28 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:28.846718 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7753dbbc-88f9-47eb-b933-a2f7593aa038 req-89315870-51aa-4c2f-ac4f-ac22cd1fca67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30f4245-aa7f-4532-bf5e-9331d456b0fe", "tag": "662103e8-589c-4152-abbe-b81cd364041e"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:28.857856 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7753dbbc-88f9-47eb-b933-a2f7593aa038 req-89315870-51aa-4c2f-ac4f-ac22cd1fca67 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.858350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7753dbbc-88f9-47eb-b933-a2f7593aa038 req-89315870-51aa-4c2f-ac4f-ac22cd1fca67 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.858785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7753dbbc-88f9-47eb-b933-a2f7593aa038 req-89315870-51aa-4c2f-ac4f-ac22cd1fca67 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.870661 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7753dbbc-88f9-47eb-b933-a2f7593aa038 req-89315870-51aa-4c2f-ac4f-ac22cd1fca67 service nova] Creating event network-changed:662103e8-589c-4152-abbe-b81cd364041e for instance d30f4245-aa7f-4532-bf5e-9331d456b0fe on hv-cinder-85061 Oct 10 12:08:28.876525 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7753dbbc-88f9-47eb-b933-a2f7593aa038 req-89315870-51aa-4c2f-ac4f-ac22cd1fca67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034254 Oct 10 12:08:28.877647 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 520/1047] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:29.791652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:29.792267 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:29.799470 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.799959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.800404 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.801152 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.801612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.802040 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.926824 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:29.934385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad6ee114-3d12-4278-b045-9380ea51e40f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.146569 Oct 10 12:08:29.934977 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 528/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:29 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:30.958518 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:30.959182 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:30.965776 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:30.966267 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:30.966705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:30.967415 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:30.967873 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:30.968296 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:31.101036 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:31.108643 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfbf5088-a705-496b-b661-916ea1b98433 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.154419 Oct 10 12:08:31.109208 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 521/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:30 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:32.130911 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:32.131540 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:32.138101 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.138612 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.139063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.139759 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.140218 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.140648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.268614 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:32.276412 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-217937bb-fe75-4625-9236-f612ff074673 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.149343 Oct 10 12:08:32.276981 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 529/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:32 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:33.299350 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:33.299883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:33.306128 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.306615 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.307082 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.307777 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.308239 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.308664 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.438355 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:33.446044 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7a971ef4-a118-4cec-bd39-64063ebc6111 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.151036 Oct 10 12:08:33.446616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 522/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:33 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:34.469645 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:34.470199 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:34.476607 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.477092 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.477527 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.478241 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.478696 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.479143 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.603449 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.610933 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ebcb0dd4-c5db-42eb-8c16-0fc3e10c262e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.145790 Oct 10 12:08:34.611489 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 530/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:34 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:35.193545 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c6b0c193-0dfb-4b4f-ab0f-174cd039c594 req-a07a8385-e596-49fe-9df8-216594e61716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30f4245-aa7f-4532-bf5e-9331d456b0fe", "name": "network-vif-plugged", "status": "completed", "tag": "662103e8-589c-4152-abbe-b81cd364041e"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:35.203635 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c6b0c193-0dfb-4b4f-ab0f-174cd039c594 req-a07a8385-e596-49fe-9df8-216594e61716 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.204121 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c6b0c193-0dfb-4b4f-ab0f-174cd039c594 req-a07a8385-e596-49fe-9df8-216594e61716 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.204554 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c6b0c193-0dfb-4b4f-ab0f-174cd039c594 req-a07a8385-e596-49fe-9df8-216594e61716 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.215740 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c6b0c193-0dfb-4b4f-ab0f-174cd039c594 req-a07a8385-e596-49fe-9df8-216594e61716 service nova] Creating event network-vif-plugged:662103e8-589c-4152-abbe-b81cd364041e for instance d30f4245-aa7f-4532-bf5e-9331d456b0fe on hv-cinder-85061 Oct 10 12:08:35.220887 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c6b0c193-0dfb-4b4f-ab0f-174cd039c594 req-a07a8385-e596-49fe-9df8-216594e61716 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039183 Oct 10 12:08:35.221489 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 523/1053] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:35.633864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:35.634483 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:35.640916 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.641405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.641846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.642542 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.643030 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.643463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.770445 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:35.778010 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4329e36f-02e6-4026-86ea-977c95fa3e3e tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.148031 Oct 10 12:08:35.778595 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 531/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:35 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:36.799144 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:36.799899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:36.803953 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:36.804658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:36.811852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.812338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.812773 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.813465 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.813919 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.814345 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.945961 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:36.955158 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ebcc0f28-7775-453a-be09-b73f3da2d6c5 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1313 microversion: 2.1 time: 0.157211 Oct 10 12:08:36.956235 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 524/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:36 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:37.979093 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:37.979704 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:37.981657 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:37.988019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:37.988506 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:37.988934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:37.989616 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:37.990063 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:37.990485 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.119615 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.127263 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0fd46df2-f0da-45eb-be0b-b14a5438a6cb tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1497 microversion: 2.1 time: 0.152570 Oct 10 12:08:38.127828 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 532/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:37 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:38.663852 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:38.664367 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:38.670949 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.671427 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.671861 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.672564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.673018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.673434 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.698278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:08:38.700889 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:38.772799 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4c743f2a-d06d-4bc7-a778-d18631c2938a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 204 len: 0 microversion: 2.1 time: 0.112211 Oct 10 12:08:38.773687 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 525/1057] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:08:38 2022] DELETE /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:08:38.781879 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:38.782493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:38.788399 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.788873 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.789300 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.789978 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.790427 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.790846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.917195 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.925052 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-60ab59e3-2d51-453a-b61a-f816ac8a827f tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1503 microversion: 2.1 time: 0.146987 Oct 10 12:08:38.925606 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 533/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:38 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:39.948373 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:39.949068 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:39.956104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.956581 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.957011 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.957697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.958147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.958564 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:40.092160 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:40.100139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b163c1e3-8ad3-4e75-846d-3e2080805128 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1503 microversion: 2.1 time: 0.155904 Oct 10 12:08:40.100712 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 526/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:39 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:40.728085 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-81bcaf7a-8125-4712-ba47-3fd1a608197b req-0a32a1b4-4049-4f9b-8441-2318505bae71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30f4245-aa7f-4532-bf5e-9331d456b0fe", "name": "network-vif-deleted", "tag": "662103e8-589c-4152-abbe-b81cd364041e"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:40.738280 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-81bcaf7a-8125-4712-ba47-3fd1a608197b req-0a32a1b4-4049-4f9b-8441-2318505bae71 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:40.738750 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-81bcaf7a-8125-4712-ba47-3fd1a608197b req-0a32a1b4-4049-4f9b-8441-2318505bae71 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:40.739208 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-81bcaf7a-8125-4712-ba47-3fd1a608197b req-0a32a1b4-4049-4f9b-8441-2318505bae71 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:40.750706 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-81bcaf7a-8125-4712-ba47-3fd1a608197b req-0a32a1b4-4049-4f9b-8441-2318505bae71 service nova] Creating event network-vif-deleted:662103e8-589c-4152-abbe-b81cd364041e for instance d30f4245-aa7f-4532-bf5e-9331d456b0fe on hv-cinder-85061 Oct 10 12:08:40.755827 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-81bcaf7a-8125-4712-ba47-3fd1a608197b req-0a32a1b4-4049-4f9b-8441-2318505bae71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031391 Oct 10 12:08:40.756574 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 534/1060] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:41.123246 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:41.123854 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:41.131361 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.131855 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.132330 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.133033 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.133494 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.133955 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.163697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.164175 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.164616 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.165058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lazy-loading 'fault' on Instance uuid d30f4245-aa7f-4532-bf5e-9331d456b0fe {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:08:41.205770 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c0a56653d8404f87b760decb8c2f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aeafae184a4a35859c9e11d25e2aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:41.213428 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-efdd2631-f2d9-49d6-9c43-880a6b1f009a tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 200 len: 1303 microversion: 2.1 time: 0.093981 Oct 10 12:08:41.213999 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 527/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:41 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:42.237510 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:42.238215 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] [instance: d30f4245-aa7f-4532-bf5e-9331d456b0fe] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:42.244336 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.244815 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.245283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.245966 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.246433 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.246845 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.260040 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] HTTP exception thrown: Instance d30f4245-aa7f-4532-bf5e-9331d456b0fe could not be found. Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Request method failure captured: Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe HTTP/1.1 Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAsmkIAmud1RCtxo-1s8xdFK3WAPupw7Fyx2mDoIKuEL_2717ylYAbxTafokTbsq20idnw-x8yGWdEtoYI1UHmp0C3zfHPd9QnB7ylsd5gzwX3yxr3i_kRzpPm09LLDd6J51JnDuBu7hbuk1fef_69zWtuP1okV9caUnuKlYM-VgJzg Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 38aeafae184a4a35859c9e11d25e2aff Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesActionsTest-2000386982 Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:08:42.261734 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38aeafae184a4a35859c9e11d25e2aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_38aeafae184a4a35859c9e11d25e2aff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/38aeafae184a4a35859c9e11d25e2aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38aeafae184a4a35859c9e11d25e2aff"}]}] Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesActionsTest-2000386982 Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 38aeafae184a4a35859c9e11d25e2aff Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesActionsTest-2000386982 Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesActionsTest-2000386982-project Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: 73c0a56653d8404f87b760decb8c2f89 Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesActionsTest-2000386982-project Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance d30f4245-aa7f-4532-bf5e-9331d456b0fe could not be found. Oct 10 12:08:42.263642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': 'd30f4245-aa7f-4532-bf5e-9331d456b0fe'} Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30f4245-aa7f-4532-bf5e-9331d456b0fe could not be found. Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:08:42.264457 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30f4245-aa7f-4532-bf5e-9331d456b0fe could not be found. Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30f4245-aa7f-4532-bf5e-9331d456b0fe could not be found. Oct 10 12:08:42.265787 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:08:42.267738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] Returning 404 to user: Instance d30f4245-aa7f-4532-bf5e-9331d456b0fe could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:08:42.267738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d608e46b-b748-45b3-bc47-9cff514d8754 tempest-VolumesActionsTest-2000386982 tempest-VolumesActionsTest-2000386982-project] 10.222.0.52 "GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe" status: 404 len: 111 microversion: 2.1 time: 0.030912 Oct 10 12:08:42.267738 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 535/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:42 2022] GET /compute/v2.1/servers/d30f4245-aa7f-4532-bf5e-9331d456b0fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:08.821430 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:08.821979 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:08.824101 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:08.824623 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-dbddb0b6-104e-4205-a43a-bf111f4f29b6 req-f524c9d6-84fe-4887-abcf-59fcd5c5812f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fe1e01-2c4c-4efa-baa0-09560129a37f", "tag": "4ec5973c-48f3-4f05-b8e3-cfca1d4deb74"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:08.825215 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:08.833827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.835083 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.835876 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.836814 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.837275 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.837535 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=25 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:08.838254 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.838704 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=49 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:08.843959 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dbddb0b6-104e-4205-a43a-bf111f4f29b6 req-f524c9d6-84fe-4887-abcf-59fcd5c5812f service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.845175 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dbddb0b6-104e-4205-a43a-bf111f4f29b6 req-f524c9d6-84fe-4887-abcf-59fcd5c5812f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.845858 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dbddb0b6-104e-4205-a43a-bf111f4f29b6 req-f524c9d6-84fe-4887-abcf-59fcd5c5812f service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.858123 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-dbddb0b6-104e-4205-a43a-bf111f4f29b6 req-f524c9d6-84fe-4887-abcf-59fcd5c5812f service nova] Creating event network-changed:4ec5973c-48f3-4f05-b8e3-cfca1d4deb74 for instance d0fe1e01-2c4c-4efa-baa0-09560129a37f on hv-cinder-85061 Oct 10 12:09:08.863445 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-dbddb0b6-104e-4205-a43a-bf111f4f29b6 req-f524c9d6-84fe-4887-abcf-59fcd5c5812f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043157 Oct 10 12:09:08.864451 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 536/1063] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:08.868544 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:09:08.962310 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b6547505-f785-4d98-b70f-127128a90dee tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 204 len: 0 microversion: 2.1 time: 0.143836 Oct 10 12:09:08.966272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 528/1064] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:09:08 2022] DELETE /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:09:08.979592 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:08.980325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:08.989533 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.990034 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.990475 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.991246 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.991701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.992323 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:09.334998 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:09.342985 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5213dd2a-bec8-4529-9b50-09f456faf06a tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1577 microversion: 2.1 time: 0.372421 Oct 10 12:09:09.343556 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 537/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:08 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1577 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:10.367699 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:10.368403 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:10.374802 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:10.375317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:10.375761 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:10.376452 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:10.376908 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:10.377338 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:10.592990 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:10.601567 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5e332a51-592a-4b29-9ee0-5654fa2dec0c tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1577 microversion: 2.1 time: 0.238097 Oct 10 12:09:10.602139 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 529/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:10 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:11.625311 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:11.625931 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:11.632680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:11.633182 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:11.633621 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:11.634310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:11.634770 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:11.635228 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:11.645527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-4dabc643-190f-4b5c-b569-733ed6b4f11c req-4fbae5aa-bbb3-4151-9b38-0f4e4aeb0394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fe1e01-2c4c-4efa-baa0-09560129a37f", "name": "network-vif-deleted", "tag": "4ec5973c-48f3-4f05-b8e3-cfca1d4deb74"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:11.656009 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4dabc643-190f-4b5c-b569-733ed6b4f11c req-4fbae5aa-bbb3-4151-9b38-0f4e4aeb0394 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:11.656421 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4dabc643-190f-4b5c-b569-733ed6b4f11c req-4fbae5aa-bbb3-4151-9b38-0f4e4aeb0394 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:11.656853 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4dabc643-190f-4b5c-b569-733ed6b4f11c req-4fbae5aa-bbb3-4151-9b38-0f4e4aeb0394 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:11.671715 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-4dabc643-190f-4b5c-b569-733ed6b4f11c req-4fbae5aa-bbb3-4151-9b38-0f4e4aeb0394 service nova] Creating event network-vif-deleted:4ec5973c-48f3-4f05-b8e3-cfca1d4deb74 for instance d0fe1e01-2c4c-4efa-baa0-09560129a37f on hv-cinder-85061 Oct 10 12:09:11.677866 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-4dabc643-190f-4b5c-b569-733ed6b4f11c req-4fbae5aa-bbb3-4151-9b38-0f4e4aeb0394 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036195 Oct 10 12:09:11.678470 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 530/1067] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:09:11.702047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:11.710680 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f4cf0ada-f1df-4699-8fa1-71cca6a89c5f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 200 len: 1390 microversion: 2.1 time: 0.089684 Oct 10 12:09:11.711292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 538/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:11 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:12.734640 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:12.735627 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: d0fe1e01-2c4c-4efa-baa0-09560129a37f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:12.742584 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:12.743106 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:12.743577 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:12.744270 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:12.744760 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:12.745213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:12.758766 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] HTTP exception thrown: Instance d0fe1e01-2c4c-4efa-baa0-09560129a37f could not be found. Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Request method failure captured: Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f HTTP/1.1 Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAmWRhKfSfxrWDjSFGFQO-V8J7a5YG5iCNscvKRcr2QRMcvTKUHNeQWC9C9PXmtirl6tafmWdIohLON-9UHtQTMIUHCZVkrOCIs_dElA5d0Y1Zw3z0yQ3aYpT4_vIe_6LDUpWd0ZyMfrBMqbjmd7A7PA_KX8igGsIWgIM5EUV2F7Vr4 Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:09:12.760453 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_638435e7c9ea431aa6ad3674ee6ff2ae", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}] Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: ce6a1b5ca7584f90bfe83b73aff1335a Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance d0fe1e01-2c4c-4efa-baa0-09560129a37f could not be found. Oct 10 12:09:12.761921 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'd0fe1e01-2c4c-4efa-baa0-09560129a37f'} Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fe1e01-2c4c-4efa-baa0-09560129a37f could not be found. Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:12.762934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fe1e01-2c4c-4efa-baa0-09560129a37f could not be found. Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fe1e01-2c4c-4efa-baa0-09560129a37f could not be found. Oct 10 12:09:12.764695 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:12.766331 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Returning 404 to user: Instance d0fe1e01-2c4c-4efa-baa0-09560129a37f could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:12.766331 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-df83b0e7-f312-462b-b988-7c8bf7cadacf tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f" status: 404 len: 111 microversion: 2.1 time: 0.031928 Oct 10 12:09:12.766331 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 531/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:12 2022] GET /compute/v2.1/servers/d0fe1e01-2c4c-4efa-baa0-09560129a37f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:15.875248 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:15.875871 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:15.877164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7aa215f0-4ffb-47a5-b05b-4850d551a284 req-40169a85-e659-4fb5-b6f7-56e76640d7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce88a43d-b7f1-4e69-b06b-038752ead6d9", "tag": "612b5334-2c73-4495-a917-6e51b705efde"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:15.888561 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7aa215f0-4ffb-47a5-b05b-4850d551a284 req-40169a85-e659-4fb5-b6f7-56e76640d7e9 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:15.888874 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:15.889061 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7aa215f0-4ffb-47a5-b05b-4850d551a284 req-40169a85-e659-4fb5-b6f7-56e76640d7e9 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:15.889445 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7aa215f0-4ffb-47a5-b05b-4850d551a284 req-40169a85-e659-4fb5-b6f7-56e76640d7e9 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:15.889697 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:15.890362 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:15.891100 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:15.891562 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:15.892491 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:15.902461 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7aa215f0-4ffb-47a5-b05b-4850d551a284 req-40169a85-e659-4fb5-b6f7-56e76640d7e9 service nova] Creating event network-changed:612b5334-2c73-4495-a917-6e51b705efde for instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 on hv-cinder-85061 Oct 10 12:09:15.910050 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7aa215f0-4ffb-47a5-b05b-4850d551a284 req-40169a85-e659-4fb5-b6f7-56e76640d7e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037013 Oct 10 12:09:15.910827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 532/1070] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:15.921757 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:09:16.005441 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fe12cc42-7394-4eba-bd80-7aeef76a7c3f tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 204 len: 0 microversion: 2.1 time: 0.134767 Oct 10 12:09:16.006087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 539/1071] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:09:15 2022] DELETE /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:09:16.014858 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:16.015680 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:16.022862 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:16.023391 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:16.023837 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:16.024551 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:16.025015 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:16.025446 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:16.164012 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:16.172107 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9f0a9e76-4d36-46ce-b3ce-bf39f04090aa tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1579 microversion: 2.1 time: 0.161414 Oct 10 12:09:16.172670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 533/1072] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:16 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:17.197538 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:17.198236 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:17.204625 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:17.205113 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:17.205546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:17.206237 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:17.206753 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:17.207145 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:17.375547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:17.383260 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8a7885bc-bb95-47fe-a244-9ee385a12517 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1579 microversion: 2.1 time: 0.189908 Oct 10 12:09:17.383810 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 540/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:17 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1579 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:18.340091 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-3fa5bf88-3e69-4305-b05b-d4d22c524d3c req-2323675e-e065-4cef-8f99-5182ae785fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce88a43d-b7f1-4e69-b06b-038752ead6d9", "name": "network-vif-deleted", "tag": "612b5334-2c73-4495-a917-6e51b705efde"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:18.350259 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3fa5bf88-3e69-4305-b05b-d4d22c524d3c req-2323675e-e065-4cef-8f99-5182ae785fa2 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:18.350741 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3fa5bf88-3e69-4305-b05b-d4d22c524d3c req-2323675e-e065-4cef-8f99-5182ae785fa2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:18.351210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3fa5bf88-3e69-4305-b05b-d4d22c524d3c req-2323675e-e065-4cef-8f99-5182ae785fa2 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.362632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-3fa5bf88-3e69-4305-b05b-d4d22c524d3c req-2323675e-e065-4cef-8f99-5182ae785fa2 service nova] Creating event network-vif-deleted:612b5334-2c73-4495-a917-6e51b705efde for instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 on hv-cinder-85061 Oct 10 12:09:18.367414 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-3fa5bf88-3e69-4305-b05b-d4d22c524d3c req-2323675e-e065-4cef-8f99-5182ae785fa2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Oct 10 12:09:18.368138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 534/1074] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:18.409912 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:18.410557 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:18.417176 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:18.417667 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:18.418108 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.418839 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:18.419319 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:18.419752 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.484799 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a1b5ca7584f90bfe83b73aff1335a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638435e7c9ea431aa6ad3674ee6ff2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:18.492993 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f00f1d27-139d-4aa2-90b1-4bbad177c52d tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 200 len: 1225 microversion: 2.1 time: 0.087572 Oct 10 12:09:18.493591 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 541/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:18 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:19.517696 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:19.518317 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: ce88a43d-b7f1-4e69-b06b-038752ead6d9] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:19.524679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.525164 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.525604 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:19.526300 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.526760 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.527218 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:19.540549 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] HTTP exception thrown: Instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 could not be found. Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Request method failure captured: Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 HTTP/1.1 Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAmWRhKfSfxrWDjSFGFQO-V8J7a5YG5iCNscvKRcr2QRMcvTKUHNeQWC9C9PXmtirl6tafmWdIohLON-9UHtQTMIUHCZVkrOCIs_dElA5d0Y1Zw3z0yQ3aYpT4_vIe_6LDUpWd0ZyMfrBMqbjmd7A7PA_KX8igGsIWgIM5EUV2F7Vr4 Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:09:19.542186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_638435e7c9ea431aa6ad3674ee6ff2ae", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}] Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: ce6a1b5ca7584f90bfe83b73aff1335a Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 could not be found. Oct 10 12:09:19.543820 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': 'ce88a43d-b7f1-4e69-b06b-038752ead6d9'} Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 could not be found. Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:19.544709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 could not be found. Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 could not be found. Oct 10 12:09:19.546622 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:19.548638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Returning 404 to user: Instance ce88a43d-b7f1-4e69-b06b-038752ead6d9 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:19.548638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-81a9b586-dfac-41fc-9d60-df6f1d12a2e4 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9" status: 404 len: 111 microversion: 2.1 time: 0.031467 Oct 10 12:09:19.548638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 535/1076] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:19 2022] GET /compute/v2.1/servers/ce88a43d-b7f1-4e69-b06b-038752ead6d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:19.979628 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:19.980119 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:19.987186 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.987676 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.988116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:19.988809 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.989269 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.989700 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:20.002519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] HTTP exception thrown: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Request method failure captured: Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 HTTP/1.1 Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRAmWRhKfSfxrWDjSFGFQO-V8J7a5YG5iCNscvKRcr2QRMcvTKUHNeQWC9C9PXmtirl6tafmWdIohLON-9UHtQTMIUHCZVkrOCIs_dElA5d0Y1Zw3z0yQ3aYpT4_vIe_6LDUpWd0ZyMfrBMqbjmd7A7PA_KX8igGsIWgIM5EUV2F7Vr4 Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:09:20.004188 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_638435e7c9ea431aa6ad3674ee6ff2ae", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}] Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: ce6a1b5ca7584f90bfe83b73aff1335a Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.005928 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': '7c012add-b9da-448b-8444-af9e38053fc1'} Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:20.006971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.008536 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.010095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Returning 404 to user: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:20.010095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e8ca850f-20c5-4384-919a-8bd9509e2223 tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 404 len: 111 microversion: 2.1 time: 0.029868 Oct 10 12:09:20.010095 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 542/1077] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:09:19 2022] DELETE /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:20.014057 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:20.014733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] [instance: 7c012add-b9da-448b-8444-af9e38053fc1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:20.020957 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:20.021442 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:20.021881 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:20.022571 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:20.023062 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:20.023492 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:20.037192 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] HTTP exception thrown: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Request method failure captured: Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 HTTP/1.1 Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept: application/json Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Connection: close Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Length: 0 Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Content-Type: application/json Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Host: 10.222.0.52 Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjRAmWRhKfSfxrWDjSFGFQO-V8J7a5YG5iCNscvKRcr2QRMcvTKUHNeQWC9C9PXmtirl6tafmWdIohLON-9UHtQTMIUHCZVkrOCIs_dElA5d0Y1Zw3z0yQ3aYpT4_vIe_6LDUpWd0ZyMfrBMqbjmd7A7PA_KX8igGsIWgIM5EUV2F7Vr4 Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Role: member,reader Oct 10 12:09:20.038651 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_638435e7c9ea431aa6ad3674ee6ff2ae", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/638435e7c9ea431aa6ad3674ee6ff2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/638435e7c9ea431aa6ad3674ee6ff2ae"}]}] Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 638435e7c9ea431aa6ad3674ee6ff2ae Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestVolumeBootPattern-851235108 Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Id: ce6a1b5ca7584f90bfe83b73aff1335a Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestVolumeBootPattern-851235108-project Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: method: > Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: exception: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.040399 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: action_args: {'id': '7c012add-b9da-448b-8444-af9e38053fc1'} Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:20.043924 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. Oct 10 12:09:20.045827 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Oct 10 12:09:20.047764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Returning 404 to user: Instance 7c012add-b9da-448b-8444-af9e38053fc1 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:20.047764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c8fe2f8f-2c3a-42d5-b314-9bcdf23b31ae tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1" status: 404 len: 111 microversion: 2.1 time: 0.029820 Oct 10 12:09:20.047764 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 536/1078] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:20 2022] GET /compute/v2.1/servers/7c012add-b9da-448b-8444-af9e38053fc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:21.339367 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cced8b4e-fccf-4fe1-b316-c18205dfc93e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] Calling method '.version_select at 0x7f86206c5c10>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:21.359446 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cced8b4e-fccf-4fe1-b316-c18205dfc93e tempest-TestVolumeBootPattern-851235108 tempest-TestVolumeBootPattern-851235108-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-535509752" status: 202 len: 0 microversion: 2.1 time: 0.023831 Oct 10 12:09:21.360026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 543/1079] 10.222.0.52 () {58 vars in 1260 bytes} [Mon Oct 10 12:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-535509752 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:09:46.886267 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:46.886830 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:46.889506 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:46.890151 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:46.898172 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:46.898710 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:46.899199 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:46.899879 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:46.900333 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:46.900751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:46.923866 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lazy-loading 'flavor' on Instance uuid da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:09:46.993671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f10bda1c-94ea-49b7-b030-2c8e8b7b0baf tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "POST /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625/action" status: 202 len: 0 microversion: 2.1 time: 0.111088 Oct 10 12:09:46.994360 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 537/1080] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:09:46 2022] POST /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:09:47.002423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:47.003078 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:47.005901 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:47.006638 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:47.014062 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:47.014547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:47.015015 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:47.015794 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:47.016310 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:47.016736 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:47.149692 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:47.157510 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-282926e8-8261-491b-be26-7f80d9e4a839 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.158840 Oct 10 12:09:47.158066 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 544/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:46 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:48.182510 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:48.183283 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:48.189359 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:48.189841 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:48.190276 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:48.191670 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:48.192130 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:48.192581 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:48.325609 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:48.333309 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4fb259a6-b287-4c15-8355-0b96e7d8524e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.155509 Oct 10 12:09:48.333877 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 538/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:48 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:49.356867 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:49.357493 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:49.364554 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:49.365041 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:49.365484 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:49.366178 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:49.366642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:49.367119 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:49.494915 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:49.502767 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9af1d30f-7da8-4961-9f74-30c275683414 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.149782 Oct 10 12:09:49.503511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 545/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:49 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:50.526117 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:50.526819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:50.533278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:50.533833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:50.534328 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:50.535104 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:50.535633 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:50.536058 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:50.668853 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:50.677550 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-29a4597d-a618-48a6-989c-ca1278a55e7f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.155951 Oct 10 12:09:50.678212 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 539/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:50 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:51.700940 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:51.701495 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:51.708702 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:51.709265 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:51.709701 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:51.710385 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:51.710838 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:51.711295 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:51.840423 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:51.848168 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-266439a1-3039-4dc1-b9a2-1ff0824db794 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.151181 Oct 10 12:09:51.848715 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 546/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:51 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:52.871926 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:52.872543 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:52.879520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:52.880005 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:52.880445 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:52.881138 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:52.881632 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:52.882059 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:53.013376 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:53.021713 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-80d3dbdd-db60-418b-bec0-4f3461b581b7 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.153677 Oct 10 12:09:53.022982 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 540/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:52 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:54.045045 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:54.045590 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:54.052366 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:54.052850 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:54.053283 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:54.053971 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:54.054425 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:54.054847 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:54.187124 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:54.195558 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b765ef92-e32a-437c-8b64-0a6d674ad441 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.155001 Oct 10 12:09:54.196116 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 547/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:54 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:55.221018 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:55.221708 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:55.229810 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:55.230527 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:55.230848 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:55.231619 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:55.232060 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:55.232491 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:55.365085 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:55.373541 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2bb9cbf2-c1b9-4573-9b52-637a30e469b5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.157280 Oct 10 12:09:55.374129 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 541/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:55 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:56.397730 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:56.398325 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:56.404668 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.405151 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.405585 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.406725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.406725 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.407207 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.543608 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:56.551567 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fa4edbcd-1b8f-49b6-9e32-37be689fa37a tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.158197 Oct 10 12:09:56.552117 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 548/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:56 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:57.573638 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:57.574229 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:57.580838 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.581320 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.581754 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.582440 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.582912 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.583337 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.716065 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:57.724603 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4d07e80d-893c-4a94-b505-a243a124d485 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.154850 Oct 10 12:09:57.725163 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 542/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:57 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:58.749279 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:58.749995 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:58.757512 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:58.757996 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:58.758544 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:58.759274 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:58.759724 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:58.760144 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:59.165137 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:59.172988 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd7a6278-8ccd-46d6-8a1c-fd214004a15b tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.427891 Oct 10 12:09:59.173546 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 549/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:58 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:00.197064 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:00.197709 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:00.204255 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:00.204752 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:00.205186 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:00.205895 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:00.206344 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:00.206768 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:00.339349 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:00.347079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-33ee1914-7bf0-459c-8e97-410b345cd701 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.153857 Oct 10 12:10:00.348166 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 543/1092] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:00 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:01.371373 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:01.371986 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:01.378329 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.378813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.379289 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.380479 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.380934 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.381358 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.518057 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:01.525882 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3e169f4c-767b-4e46-81eb-d2569607dc63 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.158385 Oct 10 12:10:01.526444 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 550/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:01 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:02.549636 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:02.550247 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:02.557663 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.558142 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.558575 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.559303 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.559762 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.560185 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.693681 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:02.702095 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-35e62ebc-299a-4a3e-9b05-2d63bac24874 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1508 microversion: 2.1 time: 0.156395 Oct 10 12:10:02.702763 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 544/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:02 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:02.727081 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:02.727610 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:02.734042 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.734530 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.735026 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.735749 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.736216 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.736648 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.764883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120662) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 12:10:02.828111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f173fa47-013d-424a-909d-c20272b41394 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "POST /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625/action" status: 202 len: 0 microversion: 2.1 time: 0.105467 Oct 10 12:10:02.829014 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 551/1095] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Oct 10 12:10:02 2022] POST /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:10:02.843035 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:02.843732 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:02.850512 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.851147 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.851656 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.852456 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.852988 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.853487 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:03.021978 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:03.030045 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3c7ddb80-9444-41a6-a439-e949fe00a7aa tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1516 microversion: 2.1 time: 0.191227 Oct 10 12:10:03.030587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 545/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:02 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:04.054460 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:04.055141 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:04.061649 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:04.062146 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:04.062642 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:04.063683 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:04.064087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:04.064565 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:04.193315 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:04.200920 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f17ae382-d082-43ce-ae30-3b526584ced6 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1518 microversion: 2.1 time: 0.151341 Oct 10 12:10:04.201489 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 552/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:04 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:05.224086 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:05.224788 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:05.231316 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:05.231808 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:05.232248 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:05.232954 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:05.234532 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:05.235514 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:05.440066 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:05.448726 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-df0857fd-f394-420c-91bf-aa92450371e5 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1574 microversion: 2.1 time: 0.228502 Oct 10 12:10:05.449305 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 546/1098] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:05 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:05.483463 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-560634d8-52d7-4a89-86a4-722dbc78354e req-b9870490-1841-4b03-88bf-88baeeeb3f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5a57fa-c3b2-4c18-8ad0-46b13e9ba625", "name": "network-vif-unplugged", "status": "completed", "tag": "ef4352e6-9d9a-4f59-bd5f-87989e5726d5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:05.494204 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-560634d8-52d7-4a89-86a4-722dbc78354e req-b9870490-1841-4b03-88bf-88baeeeb3f93 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:05.494699 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-560634d8-52d7-4a89-86a4-722dbc78354e req-b9870490-1841-4b03-88bf-88baeeeb3f93 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:05.495153 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-560634d8-52d7-4a89-86a4-722dbc78354e req-b9870490-1841-4b03-88bf-88baeeeb3f93 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:05.509547 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-560634d8-52d7-4a89-86a4-722dbc78354e req-b9870490-1841-4b03-88bf-88baeeeb3f93 service nova] Creating event network-vif-unplugged:ef4352e6-9d9a-4f59-bd5f-87989e5726d5 for instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 on hv-cinder-85061 Oct 10 12:10:05.514698 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-560634d8-52d7-4a89-86a4-722dbc78354e req-b9870490-1841-4b03-88bf-88baeeeb3f93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034863 Oct 10 12:10:05.515428 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 553/1099] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:06.471587 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:06.472222 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:06.479213 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:06.479694 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:06.480132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:06.480819 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:06.481277 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:06.481697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:06.609112 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:06.617278 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfea47f4-b1c0-47cb-8271-92ea6acb1b51 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1574 microversion: 2.1 time: 0.149545 Oct 10 12:10:06.617841 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 547/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:06 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:07.641420 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:07.642121 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:07.648237 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:07.648712 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:07.649148 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:07.649823 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:07.650276 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:07.650694 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:07.782459 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:07.790813 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d49ce4f6-f37c-4357-bc83-a1668ef61b07 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1574 microversion: 2.1 time: 0.154073 Oct 10 12:10:07.791405 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 554/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:07 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:08.813523 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:08.814132 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:08.821169 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:08.821648 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:08.822079 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:08.822758 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:08.823234 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:08.823653 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:08.950231 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:08.957833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a6f4837d-b528-4766-9110-75c5702afc35 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1574 microversion: 2.1 time: 0.148178 Oct 10 12:10:08.958393 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 548/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:08 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:09.981788 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:09.982401 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:09.988497 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:09.988980 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:09.989420 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:09.990111 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:09.990573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:09.991033 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:10.123292 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:10.131483 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6232517f-f74d-419d-a469-affa758f0542 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1574 microversion: 2.1 time: 0.153269 Oct 10 12:10:10.132049 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 555/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:09 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:11.155272 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:11.155836 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:11.162824 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:11.163342 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:11.163782 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:11.164474 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:11.164934 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:11.165364 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:11.297916 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:11.305959 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ca35169-66f0-4fec-80fa-d17a1555dbfc tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1574 microversion: 2.1 time: 0.154718 Oct 10 12:10:11.306535 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 549/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:11 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:12.329284 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:12.329914 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:12.336969 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:12.337447 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:12.337883 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:12.338573 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:12.339047 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:12.339468 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:12.468242 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:12.475864 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5078cffb-6af9-42b2-a919-9a2c9a3ceb5f tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1574 microversion: 2.1 time: 0.150636 Oct 10 12:10:12.476427 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 556/1105] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:12 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:13.499836 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:13.500449 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:13.507893 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:13.508521 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:13.509033 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:13.509733 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:13.510193 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:13.510671 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:13.643785 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:13.652127 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-270744e6-b097-4a35-ba81-d718bc16e8fb tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1561 microversion: 2.1 time: 0.156728 Oct 10 12:10:13.652697 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 550/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:13 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:15.758185 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-c22b5397-8ddf-4604-9b9c-5edd358cb6c6 req-8b52e005-1bb7-46ec-bfcb-249a7fe39a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5a57fa-c3b2-4c18-8ad0-46b13e9ba625", "name": "network-vif-plugged", "status": "completed", "tag": "ef4352e6-9d9a-4f59-bd5f-87989e5726d5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:15.767318 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c22b5397-8ddf-4604-9b9c-5edd358cb6c6 req-8b52e005-1bb7-46ec-bfcb-249a7fe39a60 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:15.767790 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c22b5397-8ddf-4604-9b9c-5edd358cb6c6 req-8b52e005-1bb7-46ec-bfcb-249a7fe39a60 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:15.768218 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c22b5397-8ddf-4604-9b9c-5edd358cb6c6 req-8b52e005-1bb7-46ec-bfcb-249a7fe39a60 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:15.779211 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-c22b5397-8ddf-4604-9b9c-5edd358cb6c6 req-8b52e005-1bb7-46ec-bfcb-249a7fe39a60 service nova] Creating event network-vif-plugged:ef4352e6-9d9a-4f59-bd5f-87989e5726d5 for instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 on hv-cinder-85061 Oct 10 12:10:15.784192 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-c22b5397-8ddf-4604-9b9c-5edd358cb6c6 req-8b52e005-1bb7-46ec-bfcb-249a7fe39a60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209612 Oct 10 12:10:15.784992 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 557/1107] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:11:27.665520 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=28 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:27.666301 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:27.667679 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:11:27.667833 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Mon Oct 10 12:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 (ip 10.222.0.52) !!! Oct 10 12:11:27.669551 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:27.670299 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:11:27.670423 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: Mon Oct 10 12:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 (ip 10.222.0.52) !!! Oct 10 12:11:27.670632 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:27.691540 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:27.692089 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:27.703793 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:27.704290 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:27.704730 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:27.705435 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:27.705893 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:27.706327 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:27.735658 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:11:27.746771 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-5c780c7c-642e-4f37-ab0b-54bfad70a635 req-9e5542d8-2e47-4ab0-86a8-1a05e6d590d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5a57fa-c3b2-4c18-8ad0-46b13e9ba625", "tag": "ef4352e6-9d9a-4f59-bd5f-87989e5726d5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:27.756531 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5c780c7c-642e-4f37-ab0b-54bfad70a635 req-9e5542d8-2e47-4ab0-86a8-1a05e6d590d5 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:27.757008 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5c780c7c-642e-4f37-ab0b-54bfad70a635 req-9e5542d8-2e47-4ab0-86a8-1a05e6d590d5 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:27.757436 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5c780c7c-642e-4f37-ab0b-54bfad70a635 req-9e5542d8-2e47-4ab0-86a8-1a05e6d590d5 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:27.769975 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-5c780c7c-642e-4f37-ab0b-54bfad70a635 req-9e5542d8-2e47-4ab0-86a8-1a05e6d590d5 service nova] Creating event network-changed:ef4352e6-9d9a-4f59-bd5f-87989e5726d5 for instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 on hv-cinder-85061 Oct 10 12:11:27.776554 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-5c780c7c-642e-4f37-ab0b-54bfad70a635 req-9e5542d8-2e47-4ab0-86a8-1a05e6d590d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110053 Oct 10 12:11:27.777350 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 558/1108] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:11:27.816730 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ae814e17-fc47-4ca9-9253-10f508b55646 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "DELETE /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 204 len: 0 microversion: 2.1 time: 0.152519 Oct 10 12:11:27.821705 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 551/1109] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Oct 10 12:11:27 2022] DELETE /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:11:27.830781 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:27.835020 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:27.847613 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:27.848519 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:27.849021 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:27.849846 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:27.850377 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:27.850924 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:27.987823 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:27.995261 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-51375d6c-0a0a-4cf5-a0bf-f9d9eda9a4ee tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.172200 Oct 10 12:11:27.995841 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 559/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:27 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:29.020090 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:29.021115 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:29.027751 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:29.028232 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:29.028657 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:29.029340 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:29.029791 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:29.030210 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:29.189899 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:29.198590 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5647d70a-0bdb-44f0-ab20-a7c7efc9cf9e tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1567 microversion: 2.1 time: 0.182789 Oct 10 12:11:29.199211 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 552/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:29 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:30.198073 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-77bcc8e1-846b-40bd-8d11-0ff1daea924f req-d3d1181c-a63b-44e7-bd29-2a935d37ec60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5a57fa-c3b2-4c18-8ad0-46b13e9ba625", "name": "network-vif-deleted", "tag": "ef4352e6-9d9a-4f59-bd5f-87989e5726d5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:30.208354 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-77bcc8e1-846b-40bd-8d11-0ff1daea924f req-d3d1181c-a63b-44e7-bd29-2a935d37ec60 service nova] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:30.208878 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-77bcc8e1-846b-40bd-8d11-0ff1daea924f req-d3d1181c-a63b-44e7-bd29-2a935d37ec60 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:30.209345 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-77bcc8e1-846b-40bd-8d11-0ff1daea924f req-d3d1181c-a63b-44e7-bd29-2a935d37ec60 service nova] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:30.220652 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-77bcc8e1-846b-40bd-8d11-0ff1daea924f req-d3d1181c-a63b-44e7-bd29-2a935d37ec60 service nova] Creating event network-vif-deleted:ef4352e6-9d9a-4f59-bd5f-87989e5726d5 for instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 on hv-cinder-85061 Oct 10 12:11:30.221839 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:30.222455 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:30.225842 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-77bcc8e1-846b-40bd-8d11-0ff1daea924f req-d3d1181c-a63b-44e7-bd29-2a935d37ec60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087766 Oct 10 12:11:30.226155 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 560/1112] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Oct 10 12:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:11:30.232389 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:30.232872 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:30.233308 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:30.234006 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:30.234460 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:30.234883 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:30.300040 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe67ba70aef540e98dc56fe609077f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52575749f6f6409b947c28bb16649eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:30.308685 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b8822b07-b3ff-4902-8be4-ecdbc46563b2 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 200 len: 1219 microversion: 2.1 time: 0.090802 Oct 10 12:11:30.309249 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 553/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:30 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:31.332729 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:31.333426 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] [instance: da5a57fa-c3b2-4c18-8ad0-46b13e9ba625] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:31.340019 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:31.340498 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:31.340932 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:31.341615 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Acquiring lock "6386297d-cd21-4182-a19e-d3837d7beef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:31.342079 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:31.342489 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Lock "6386297d-cd21-4182-a19e-d3837d7beef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:31.355894 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] HTTP exception thrown: Instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 could not be found. Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Request method failure captured: Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 HTTP/1.1 Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept: application/json Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Connection: close Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Length: 0 Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Content-Type: application/json Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Host: 10.222.0.52 Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjRArbUfa7OxduLtCkP3lKOzdie7kcrHcd8agFOo2bQ8hknoeVs3KDkHY7OZaM4m6SEkWJhvNRacztWuKUE7oSfNQ8tjEm2jpKRlPHi-ZDCuoFt6DgnoFaDQ5BpFLCwwA9qZk0WMD70pit_0ZJuG5JWgMTyBIZKb6Qr0kvDrwixaTamAk Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Id: 52575749f6f6409b947c28bb16649eb7 Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestShelveInstance-1647730717 Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Role: member,reader Oct 10 12:11:31.357511 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52575749f6f6409b947c28bb16649eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_52575749f6f6409b947c28bb16649eb7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/52575749f6f6409b947c28bb16649eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52575749f6f6409b947c28bb16649eb7"}]}] Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestShelveInstance-1647730717 Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 52575749f6f6409b947c28bb16649eb7 Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestShelveInstance-1647730717 Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User: tempest-TestShelveInstance-1647730717-project Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Id: fe67ba70aef540e98dc56fe609077f93 Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestShelveInstance-1647730717-project Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: method: > Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: exception: Instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 could not be found. Oct 10 12:11:31.359456 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: action_args: {'id': 'da5a57fa-c3b2-4c18-8ad0-46b13e9ba625'} Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 could not be found. Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:11:31.360637 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 could not be found. Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 could not be found. Oct 10 12:11:31.362443 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Oct 10 12:11:31.364087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Returning 404 to user: Instance da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:11:31.364087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-eb33091c-6bf9-419c-8504-64c453ca8704 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625" status: 404 len: 111 microversion: 2.1 time: 0.030851 Oct 10 12:11:31.364087 dv-cinder-850618-4-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 561/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:31 2022] GET /compute/v2.1/servers/da5a57fa-c3b2-4c18-8ad0-46b13e9ba625 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:11:31.518455 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-15036a4f-5621-445e-bba5-0fea2fbd4b29 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] Calling method '.version_select at 0x7f86207b19d0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:31.543631 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-15036a4f-5621-445e-bba5-0fea2fbd4b29 tempest-TestShelveInstance-1647730717 tempest-TestShelveInstance-1647730717-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305845405" status: 202 len: 0 microversion: 2.1 time: 0.029054 Oct 10 12:11:31.544242 dv-cinder-850618-4-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 554/1115] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Oct 10 12:11:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305845405 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)